-- Logs begin at Thu 2022-10-06 11:41:27 UTC, end at Thu 2022-10-06 12:52:08 UTC. -- Oct 06 12:12:54.593691 dv-cinder-856041-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 06 12:12:54.602377 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 06 12:12:54.604359 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 6 12:12:54 2022] *** Oct 06 12:12:54.604359 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 06 12:12:54.604359 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 06 12:12:54.604359 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: nodename: dv-cinder-856041-2-iscsi Oct 06 12:12:54.604359 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: machine: x86_64 Oct 06 12:12:54.604359 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: clock source: unix Oct 06 12:12:54.604359 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: pcre jit disabled Oct 06 12:12:54.604359 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: detected number of CPU cores: 4 Oct 06 12:12:54.604359 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: current working directory: / Oct 06 12:12:54.604359 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: detected binary path: /usr/bin/uwsgi-core Oct 06 12:12:54.604359 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: your processes number limit is 47680 Oct 06 12:12:54.604359 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: your memory page size is 4096 bytes Oct 06 12:12:54.604359 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: detected max file descriptor number: 2048 Oct 06 12:12:54.604359 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: lock engine: pthread robust mutexes Oct 06 12:12:54.605180 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: thunder lock: enabled Oct 06 12:12:54.605180 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 06 12:12:54.605180 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 06 12:12:54.643565 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: Python main interpreter initialized at 0x5566bf1919c0 Oct 06 12:12:54.643565 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: python threads support enabled Oct 06 12:12:54.643565 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: your server socket listen backlog is limited to 100 connections Oct 06 12:12:54.643565 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: your mercy for graceful operations on workers is 90 seconds Oct 06 12:12:54.643930 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: mapped 403077 bytes (393 KB) for 2 cores Oct 06 12:12:54.644008 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: *** Operational MODE: preforking *** Oct 06 12:12:54.644211 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: *** uWSGI is running in multiple interpreter mode *** Oct 06 12:12:54.644211 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: spawned uWSGI master process (pid: 105356) Oct 06 12:12:54.644388 dv-cinder-856041-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 06 12:12:54.644913 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: spawned uWSGI worker 1 (pid: 105357, cores: 1) Oct 06 12:12:54.645530 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: spawned uWSGI worker 2 (pid: 105358, cores: 1) Oct 06 12:12:54.645689 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 06 12:12:55.307114 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 12:12:55.310783 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 12:12:56.382976 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:12:56.382976 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: from cryptography.utils import int_from_bytes Oct 06 12:12:56.383674 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:12:56.383674 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: from cryptography.utils import int_from_bytes Oct 06 12:12:56.387804 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:12:56.387804 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: from cryptography.utils import int_from_bytes Oct 06 12:12:56.388235 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:12:56.388235 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: from cryptography.utils import int_from_bytes Oct 06 12:12:58.834553 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 12:12:58.835240 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 12:12:58.835339 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 12:12:58.835697 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 12:12:58.835954 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 12:12:58.836340 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.836667 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.836992 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.837314 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.837645 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.837743 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 12:12:58.838114 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.838211 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 12:12:58.838298 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.838493 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 12:12:58.838589 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.838851 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 12:12:58.838945 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.839105 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 12:12:58.839193 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.839425 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.839537 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.839778 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856041-2-iscsi {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.839886 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.840103 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.840212 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.840408 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.840567 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.840720 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.840819 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.841039 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.841133 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.841344 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.841437 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.841656 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.841754 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.841963 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.842055 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.842224 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.842464 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.842577 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.843643 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856041-2-iscsi {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.843789 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.843906 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.844002 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.844093 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.844190 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.844277 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.844362 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.844447 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.844532 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.844675 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.844768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.844853 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.844939 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.845024 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.845110 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.845363 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.845458 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.845675 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.845769 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.846014 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.846151 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856041-2-iscsi {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.846318 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.846416 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.846650 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.846790 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.846961 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.847060 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.847268 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.847360 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.847607 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.847728 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.847943 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.848032 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.848264 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.848361 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.848572 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.848669 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.848949 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.849039 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856041-2-iscsi {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.849260 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.849345 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.849570 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.849666 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.849881 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.849982 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.850205 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.850308 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.850508 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.850640 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.850819 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.850913 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.851128 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.851222 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.851456 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.851558 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.851801 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.851913 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.852107 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.852205 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.852359 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.852452 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.852668 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.852761 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.852990 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.853083 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.853309 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.853410 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.853616 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.853710 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.853869 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.853965 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.854120 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.854223 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.854437 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.854530 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.854757 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.854851 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.855022 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.855120 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.855328 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.855420 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.855669 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.855759 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.855978 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.856071 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.856286 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.856381 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.856532 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.856624 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.856780 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.856881 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.857094 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.857192 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.857412 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.857552 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.857717 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.857816 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.858024 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.858121 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.858330 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.858428 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.858634 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.858722 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.858937 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.859059 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.859239 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.859334 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.859562 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.859652 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.859868 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.859955 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.860183 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.860333 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.860494 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.860582 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.860819 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.860905 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.861123 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.861217 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.861441 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.861541 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.861757 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.861896 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.862066 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.862154 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.862367 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.862453 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.862704 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.862799 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.863005 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.863092 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.863256 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.863879 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.864122 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.864217 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.864431 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.864520 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.864755 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.864853 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.865056 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.865151 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.865362 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.865454 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.865671 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.865774 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.865974 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.866080 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.866283 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.866380 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.866529 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.866621 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.866831 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.866932 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.867133 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.867221 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.867448 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.867574 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.867789 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.867887 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.868090 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.868177 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.868394 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.868480 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.868695 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.868843 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.868997 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.869097 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.869297 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.869383 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.869618 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.869707 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.869901 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.869996 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.870203 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.870298 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.870504 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.870670 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.870808 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.870946 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.871110 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.871213 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.871410 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.871498 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.871732 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.871821 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.872049 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.872196 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.872340 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.872473 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.872643 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.872774 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.872942 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.873085 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.873233 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.873385 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.873519 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.873652 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.873836 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.873978 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.874122 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.874263 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.874422 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.874567 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.874735 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.874876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.875037 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.875171 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.875338 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.875472 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.875669 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.875800 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.875970 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.876112 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.876253 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.876385 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.876560 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.876707 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.876839 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.876971 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.877140 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.877274 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.877438 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.877533 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.877742 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.877827 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.878040 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.878129 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.878340 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.878441 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.878637 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.878730 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.878934 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.879061 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.879836 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.879941 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.880178 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.880273 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.880508 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.880594 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.880805 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.880892 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.881125 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.881215 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.881443 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.881531 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.881748 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.881836 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.882052 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.882138 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.882353 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.882447 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.882666 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:12:58.882765 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.882994 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.883088 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.883314 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.883400 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.883653 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.883755 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.883967 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.884060 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.884287 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.884382 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.884608 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.884695 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.884919 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.885005 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.885228 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.885324 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.885538 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.885625 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.885855 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.885955 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.886159 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.886259 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.886467 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.886560 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.886774 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.886861 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.887087 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.887185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.887401 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.887495 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.887750 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.887836 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.888059 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.888164 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.888373 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.888466 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.888688 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.888850 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.888998 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.889100 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.889310 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.889397 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.889618 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.889704 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.889931 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.890020 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.890233 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.890320 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.890569 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.890657 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.890880 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.890975 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.891201 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.891291 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.891527 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.891616 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.891851 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.891938 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.892158 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.892259 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.892464 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.892557 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.892771 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.892869 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.893082 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.893176 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.893394 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.893490 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.893701 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.893795 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.894016 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.894111 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.894324 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.894420 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.894664 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.894753 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.894977 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.895314 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.895561 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.895671 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.895872 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.895961 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.896183 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.896281 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.896487 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.896590 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.896789 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.896891 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.897093 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.897181 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.897398 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.897486 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.897707 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.897805 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.898011 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.898104 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.898323 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.898410 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.898631 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.898731 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.898939 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.899025 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.899244 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.899341 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.899571 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.899672 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.899875 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.899969 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.900176 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.900265 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.900480 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.900567 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.900777 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.900863 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.901087 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.901223 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.901399 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.901493 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.901701 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.901799 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.902029 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.902116 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.902332 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.902428 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.902636 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.902731 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.902938 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.903024 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.903241 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.903335 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.903564 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.903668 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.903878 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.903966 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.904185 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.904279 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.904488 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.904587 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.904798 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.904891 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.905104 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.905189 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.905405 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.905492 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.905726 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.905812 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.906027 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.906113 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.906331 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.906425 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.906642 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.906730 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.906950 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.907037 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.907259 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.907353 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.907592 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.907696 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.907903 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.907999 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.908216 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.908303 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.908522 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.908615 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.908825 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.908924 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.909134 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.909222 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.909441 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.909529 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.909752 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.909846 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.910055 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.910141 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.910887 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.910977 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.911198 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.911340 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.911524 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.911614 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.911834 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.911931 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.912138 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.912227 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.912441 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.912536 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.912744 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.912831 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.913047 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.913136 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.913347 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.913432 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.913650 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.913737 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.913952 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.914040 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.914253 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.914341 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.914554 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.914641 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.914873 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.914968 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.915179 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.915266 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.915479 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.915600 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.915809 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.915898 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.916110 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.916198 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.916450 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.916545 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.916753 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.916839 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.917079 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.917164 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.917402 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.917496 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.917716 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.917817 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.918034 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.918120 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.918340 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.918438 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.918651 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.918739 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.918959 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.919046 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.919270 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.919368 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.919597 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.919697 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.919906 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.919991 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.920223 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.920312 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.920531 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.920619 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.920847 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.920973 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.921153 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.921243 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.921485 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.921595 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.921775 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.921874 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.922082 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.922171 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.922382 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.922520 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.922693 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.922782 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.923002 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.923090 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.923323 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.923417 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.923659 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.923760 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.923979 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.924065 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.924288 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.924382 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.924598 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.924692 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.924906 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.924993 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.925213 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.925299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.925517 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.925612 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.925847 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.926497 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.926690 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.926783 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.927000 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.927099 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.927318 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.927405 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.927655 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.927791 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.927978 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.928120 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.928286 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.928373 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.928596 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.928684 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.928896 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.928983 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.929205 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.929290 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.929513 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.929602 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.929824 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.929913 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.930135 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.930219 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.930442 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.930533 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.930752 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.930841 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.931057 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.931152 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.931365 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.931451 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.931696 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.931790 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.931996 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.932082 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.932296 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.932394 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.932602 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.932687 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.932914 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.933010 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.933221 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.933320 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.933529 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.933624 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.933829 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.933916 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.934137 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.934231 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.934439 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.934532 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.934739 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.934835 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.935039 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.935136 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.935345 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.935491 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.935676 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.935776 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.935980 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.936069 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.936296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.936382 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.936617 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.936704 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.936916 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.937003 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.937215 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.937300 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.937535 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.937620 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.937838 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.937935 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.938141 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.938229 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.938443 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.938542 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.938743 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.938830 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.939061 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.939147 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.939373 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.939468 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.939697 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.939784 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.940006 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.940099 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.940318 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.940412 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.940624 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.940711 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.940932 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.941017 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.941235 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.941338 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.941584 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.941670 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.941898 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.941985 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.942207 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.942300 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.942515 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.942603 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.942823 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.942917 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.943131 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.943225 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.943442 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.943720 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.943808 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.944057 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.944161 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.944375 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.944463 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.944680 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.944766 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.944988 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.945083 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.945291 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.945388 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.945600 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.945699 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.945938 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.946024 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.946266 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.946469 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.946571 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.946798 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.946898 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.947114 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.947223 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.947431 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.947554 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.947772 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.947879 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.948082 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.948228 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.948388 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.948477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.948692 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.948782 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.949001 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.949088 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.949304 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.949400 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.949608 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.949695 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.949907 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.950001 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.950206 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.950299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.950514 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.950601 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.950809 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.950915 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.951105 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.951191 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.951406 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.951561 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.951749 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.951874 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.952033 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.952126 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.952337 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.952428 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.952637 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.952752 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.952938 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.953054 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.953244 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.953339 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.953542 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.953635 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.953850 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.953941 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.954153 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.954245 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.954471 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.954563 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.954778 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.954876 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.955077 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.955174 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.955377 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.955476 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.955700 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.955800 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.956034 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.956124 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.956334 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.956423 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.956640 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.956728 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.956950 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.957048 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.957287 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.957378 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.957600 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.957690 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.957910 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.958009 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.958224 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.958364 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.958523 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.958611 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.958819 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.958919 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.959116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.959204 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.959415 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.959515 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.959738 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.959837 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.960037 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.960125 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.960334 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.960428 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.960635 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.960730 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.960936 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.961029 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.961241 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.961364 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.961542 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.961642 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.961843 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.961929 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.962139 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.962225 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.962446 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.962533 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.962749 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.962846 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.963046 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.963143 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.963341 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.963432 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.963669 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.963760 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.963974 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.964072 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.964271 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.964360 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.964577 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.964672 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.964876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.964976 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.965175 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.965262 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.965474 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.965561 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.965773 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.965872 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.966072 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.966159 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.966371 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.966458 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.966670 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.966765 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.966969 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.967064 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.967286 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.967373 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.967609 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.967702 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.967909 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.968006 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.968210 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.968297 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.968513 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.968607 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.968809 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.968904 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.969107 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.969194 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.969406 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.969492 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.969719 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.969834 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.970008 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.970109 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.970305 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.970404 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.970607 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.970705 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.970904 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.971010 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.971205 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.971304 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.971542 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.971642 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.971836 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.971989 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.972136 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.972223 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.972430 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.972524 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.973272 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.973386 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.973585 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.973675 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.973886 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.973988 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.974206 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.974302 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.974511 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.974598 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.974812 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.974901 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.975112 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.975202 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.975409 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.975498 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.975765 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.975854 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.976067 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.976161 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.976381 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.976466 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.976697 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.976784 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.977003 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.977092 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.977308 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.977403 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.977614 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.977700 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.977926 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.978015 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.978235 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.978322 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.978536 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.978638 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.978851 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.978940 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.979160 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.979247 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.979467 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.979587 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.979788 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.979875 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.980090 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.980178 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.980394 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.980489 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.980701 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.980796 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.981004 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.981091 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.981314 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.981415 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.981628 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.981726 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.981938 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.982072 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.982235 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.982331 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.982542 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.982629 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.982847 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.982932 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.983147 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.983236 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.983456 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.983583 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.983782 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.983869 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.984090 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.984179 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.984399 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.984485 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.984703 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.984790 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.985008 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.985103 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.985310 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.985396 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.985610 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.985704 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.985912 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.985999 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.986214 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.986339 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.986518 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.986652 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.986840 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.986965 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.987147 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.987271 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.987449 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.987608 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.987779 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.987920 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.988080 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.988236 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.988439 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.989101 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.989245 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.989399 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.989668 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.989816 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.989979 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.990131 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.990290 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.990442 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.990594 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.990754 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.990901 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.991060 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.991211 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.991362 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.991542 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.991711 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.991867 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.992044 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.992172 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.992339 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.992584 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.992673 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.992895 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.992984 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.993223 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.993318 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.993511 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.993610 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.993811 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.993901 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.994111 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.994242 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.994417 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.994555 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.994738 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.994860 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.995039 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.995276 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.995372 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.995613 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.995703 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.995927 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.996014 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.996241 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.996339 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.996560 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.996649 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.996885 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.996983 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.997192 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.997371 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.997507 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.997609 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.997818 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.997948 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.998142 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.998257 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.998466 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.998554 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.998779 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.998867 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.999096 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.999185 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.999404 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.999574 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.999754 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:58.999888 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.000081 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.000214 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.000385 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.000527 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.000704 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.000840 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.001026 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.001157 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.001335 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.001479 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.001648 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.001798 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.001958 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.002098 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.002284 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.002411 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.002605 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.002715 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.002916 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.003016 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.003234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.003335 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.003559 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.003668 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.003867 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.003989 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.004217 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.004310 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.004524 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.004615 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.004837 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.004927 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.005149 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.005241 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.005461 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.005553 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.005765 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.005855 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.006068 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.006165 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.006372 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.006470 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.006680 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.006777 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.006981 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.007077 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.007290 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.007382 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.007617 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.007732 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.007926 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.008024 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.008227 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.008325 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.008529 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.008628 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.008843 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.008932 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.009144 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.009304 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.009459 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.009604 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.009741 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.009876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.010063 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.010199 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.010370 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.010503 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.010669 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.010805 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.010990 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.011120 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.011297 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.011429 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.011622 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.011754 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.011931 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.012063 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.012232 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.012382 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.012572 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.012705 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.012874 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.013010 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.013191 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.013328 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.013514 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.013656 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.013828 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.013923 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.014112 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.014202 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.014424 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.014512 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.014731 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.014897 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.015037 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.015126 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.015342 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.015443 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.015674 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.015777 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.015979 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.016067 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.016281 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.016367 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.016582 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.016678 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.016890 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.016984 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.017193 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.017279 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.017492 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.017580 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.017794 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.017883 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.018101 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.018188 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.018402 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.018500 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.018708 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.018796 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.019011 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.019098 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.019337 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.019433 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.019712 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.019809 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.020024 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.020409 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.020602 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.020837 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.020926 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.021226 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.021311 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.021545 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.021703 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.021862 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.022133 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.022222 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.022483 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.022605 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.022797 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.023046 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.023141 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.023381 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.023469 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.023722 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.023818 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.024049 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.024151 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.024365 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.024568 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.024670 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.024896 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.024985 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.025213 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.025308 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.025529 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.025617 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.025842 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.025930 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.026155 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.026244 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.026469 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.026559 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.026780 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.026866 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.027087 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.027173 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.027396 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.027484 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.027734 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.028004 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.028094 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.028339 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.028429 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.028655 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.028760 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.028971 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.029059 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.029282 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.029378 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.029593 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.029681 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.029904 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.029999 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.030214 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.030310 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.030522 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.030610 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.030829 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.030925 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.031136 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.031225 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.031460 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.031576 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.031803 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.031899 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.032119 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.032207 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.032435 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.032522 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.032749 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.032837 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.033061 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.033147 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.033371 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.033458 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.033681 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.033769 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.033993 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.034086 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.034310 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.034398 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.034622 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.034711 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.034936 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.035032 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.035787 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.035903 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.036105 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.036201 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.036415 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.036503 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.036727 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.036824 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.037039 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.037127 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.037352 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.037552 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.037661 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.037868 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.038020 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.038204 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.038292 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.038531 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.038627 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.038858 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.038958 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.039177 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.039265 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.039493 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.039625 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.039828 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.039919 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.040136 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.040230 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.040443 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.040544 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.040754 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.040953 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.041063 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.041265 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.041354 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.041596 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.041685 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.041920 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.042008 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.042244 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.042340 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.042559 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.042652 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.042864 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.042950 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.043183 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.043404 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.043493 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.043776 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.043864 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.044091 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.044178 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.044399 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.044491 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.044700 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.044794 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.045019 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.045189 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.045326 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.045414 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.045626 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.045714 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.045942 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.046038 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.046246 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.046332 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.046563 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.046770 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.046865 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.047109 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.047198 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.047420 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.047553 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.047768 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.047856 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.048079 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.048187 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.048375 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.048467 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.048684 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.048781 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.048987 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.049075 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.049292 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.049378 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.049595 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.049704 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.049899 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.049993 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.050202 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.050297 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.050507 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.050604 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.050827 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.051538 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.051679 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.051936 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.052086 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.052282 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.052421 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.052595 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.052817 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.052905 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.053195 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.053288 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.053508 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.053653 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.053820 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.054119 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.054213 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.054466 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.054555 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.054767 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.054867 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.055093 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.055212 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.055401 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.055670 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.055774 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.056039 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.056132 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.056352 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.056540 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.056675 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.056964 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.057052 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.057287 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.057377 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.057634 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.057800 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.057953 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.058110 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.058491 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.058580 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.058834 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.058921 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.059159 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.059335 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.059496 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.059852 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.059987 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.060163 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.060297 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.060470 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.060719 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.060808 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.061087 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.061185 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.061400 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.061496 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.061714 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.061801 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.062025 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.062114 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.062336 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.062436 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.062649 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.062746 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.062962 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.063050 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.063274 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.063371 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.063615 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.063706 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.063929 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.064032 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.064241 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.064485 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.064575 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.064821 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.064910 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.065144 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.065240 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.065453 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.065540 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.065768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.065856 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.066087 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.066182 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.066393 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.066500 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.066721 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.066810 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.067043 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.067144 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.067354 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.067443 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.067691 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.067778 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.067998 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.068093 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.068306 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.068399 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.068614 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.068701 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.068923 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.069012 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.069234 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.069322 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.069544 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.069633 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.069850 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.069937 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.070154 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.070462 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.070550 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.070769 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.070866 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.071076 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.071165 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.071385 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.071473 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.071734 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.071827 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.072067 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.072154 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.072388 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.072476 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.072700 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.072790 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.073011 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.073104 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.073324 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.073419 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.073630 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.073716 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.073938 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.074035 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.074246 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.074342 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.074552 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.074648 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.074866 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.074954 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.075192 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.075287 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.075499 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.075643 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.075826 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.075915 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.076143 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.076454 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.076542 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.076760 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.076848 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.077064 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.077160 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.077374 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.077464 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.077677 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.077766 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.077981 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.078074 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.078286 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.078381 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.078591 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.078679 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.078899 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.078995 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.079201 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.079296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.079535 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.079626 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.079828 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.079918 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.080132 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.080220 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.080436 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.080523 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.080741 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.080831 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.081048 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.081144 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.081351 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.081438 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.081655 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.081742 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.081956 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.082063 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.082284 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.082379 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.082587 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.082712 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.082889 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.082978 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.083195 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.083297 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.083498 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.083604 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.083825 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.083913 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.084126 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.084231 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.084428 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.084516 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.084778 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.084872 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.085033 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.085130 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.085334 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.085434 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.085634 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.085722 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.085932 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.086029 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.086230 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.086318 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.086529 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.086624 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.086833 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.086922 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.087131 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.087219 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.087431 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.087536 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.087755 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.087844 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.088054 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.088143 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.088354 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.088450 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.088683 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.088780 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.089016 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.089155 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.089327 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.089432 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.089647 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.089736 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.089957 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.090048 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.090272 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.090367 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.090574 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.090668 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.090892 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.090980 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.091204 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.091300 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.091563 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.091654 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.091838 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.091926 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.092149 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.092253 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.092463 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.092551 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.092768 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.092854 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.093079 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.093166 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.093383 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.093470 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.093690 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.093777 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.093996 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.094085 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.094320 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.094409 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.094645 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.094745 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.094950 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.095039 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.095272 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.095358 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.095607 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.095709 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.095928 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.096016 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.096242 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.096329 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.096554 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.096655 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.096883 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.096978 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.097193 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.097280 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.097504 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.097600 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.098335 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.098431 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.098584 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 12:12:59.098703 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.099018 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.099333 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.099673 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.099986 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.100302 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.100616 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.100944 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.101268 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.101575 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.101897 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.102222 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.102565 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.102883 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.103223 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.103573 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.103890 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.104199 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.104502 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:12:59.104742 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 12:12:59.250716 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO dbcounter [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] Registered counter for database nova_api Oct 06 12:12:59.257133 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO dbcounter [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] Registered counter for database nova_api Oct 06 12:12:59.276218 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_db.sqlalchemy.engines [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:12:59.277545 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG oslo_db.sqlalchemy.engines [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:12:59.280280 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG dbcounter [-] [105358] Writer thread running {{(pid=105358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:12:59.284120 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG dbcounter [-] [105357] Writer thread running {{(pid=105357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:12:59.338018 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.context [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb99d91a-faea-4edc-b2f3-5f1d1dc1315d(cell1) {{(pid=105358) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 12:12:59.341888 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:12:59.342031 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.context [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb99d91a-faea-4edc-b2f3-5f1d1dc1315d(cell1) {{(pid=105357) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 12:12:59.342366 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:12:59.344015 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:12:59.344742 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:12:59.345187 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:12:59.345903 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG oslo_concurrency.lockutils [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:12:59.346379 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG oslo_concurrency.lockutils [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:12:59.347161 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:12:59.347959 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG oslo_concurrency.lockutils [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:12:59.348696 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG oslo_concurrency.lockutils [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:12:59.349145 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG oslo_concurrency.lockutils [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:12:59.349240 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO dbcounter [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] Registered counter for database nova_cell0 Oct 06 12:12:59.351139 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG oslo_concurrency.lockutils [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:12:59.353204 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO dbcounter [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] Registered counter for database nova_cell1 Oct 06 12:12:59.353359 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO dbcounter [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] Registered counter for database nova_cell0 Oct 06 12:12:59.357533 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO dbcounter [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] Registered counter for database nova_cell1 Oct 06 12:12:59.362098 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_db.sqlalchemy.engines [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:12:59.362644 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_db.sqlalchemy.engines [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:12:59.365322 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG oslo_db.sqlalchemy.engines [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:12:59.368388 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG dbcounter [-] [105358] Writer thread running {{(pid=105358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:12:59.368794 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG oslo_db.sqlalchemy.engines [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:12:59.371047 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG dbcounter [-] [105358] Writer thread running {{(pid=105358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:12:59.371728 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG dbcounter [-] [105357] Writer thread running {{(pid=105357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:12:59.514014 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG dbcounter [-] [105357] Writer thread running {{(pid=105357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:12:59.520990 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO dbcounter [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] Registered counter for database nova_cell0 Oct 06 12:12:59.523357 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO dbcounter [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] Registered counter for database nova_cell0 Oct 06 12:12:59.529726 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_db.sqlalchemy.engines [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:12:59.533300 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG oslo_db.sqlalchemy.engines [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:12:59.534423 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG dbcounter [-] [105358] Writer thread running {{(pid=105358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:12:59.538013 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG dbcounter [-] [105357] Writer thread running {{(pid=105357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:12:59.871091 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: WARNING keystonemiddleware.auth_token [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:12:59.871662 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: WARNING keystonemiddleware.auth_token [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:12:59.878478 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: WARNING keystonemiddleware.auth_token [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:12:59.879123 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: WARNING keystonemiddleware.auth_token [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:13:00.218925 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: WARNING keystonemiddleware.auth_token [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:13:00.220994 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: WARNING keystonemiddleware.auth_token [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:13:00.225424 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: WARNING keystonemiddleware.auth_token [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:13:00.227473 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: WARNING keystonemiddleware.auth_token [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:13:00.230645 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5566bf1919c0 pid: 105357 (default app) Oct 06 12:13:00.232732 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:13:00.232844 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5566bf1919c0 pid: 105358 (default app) Oct 06 12:13:00.233928 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-4a21f2a6-84c4-4e7a-867f-f88a3be36aa8 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001755 Oct 06 12:13:00.234329 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Thu Oct 6 12:13:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:14:21.227247 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:14:21.228495 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001989 Oct 06 12:14:21.228914 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 12:14:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:14:21.245509 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG dbcounter [-] [105357] Writing DB stats nova_api:SELECT=3 {{(pid=105357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:21.246303 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG dbcounter [-] [105357] Writing DB stats nova_cell0:SELECT=3 {{(pid=105357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:21.247135 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG dbcounter [-] [105357] Writing DB stats nova_cell1:SELECT=3 {{(pid=105357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:21.248181 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG dbcounter [-] [105357] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:22.120265 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-310dd8cd-fa1a-4ccf-99bd-e17131702716 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:14:22.153691 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-310dd8cd-fa1a-4ccf-99bd-e17131702716 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918563 Oct 06 12:14:22.155550 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Oct 6 12:14:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:14:24.732973 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:14:24.734032 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-042822e6-bab3-4b49-ad38-5d932097945b None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 06 12:14:24.734424 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 2/4] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 12:14:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:14:25.197019 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-f56aa9d0-2f4f-4a91-9394-e778b5d6d5c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:25.253014 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-f56aa9d0-2f4f-4a91-9394-e778b5d6d5c6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.512314 Oct 06 12:14:25.253591 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 3/5] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 12:14:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 12:14:25.267044 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG dbcounter [-] [105358] Writing DB stats nova_api:SELECT=3 {{(pid=105358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:25.267975 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG dbcounter [-] [105358] Writing DB stats nova_cell1:SELECT=3 {{(pid=105358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:25.270190 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG dbcounter [-] [105358] Writing DB stats nova_cell0:SELECT=3 {{(pid=105358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:25.271381 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG dbcounter [-] [105358] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:25.479318 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-364e74af-2d64-48c0-85cc-16568e4afb08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:25.551688 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-364e74af-2d64-48c0-85cc-16568e4afb08 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289770 Oct 06 12:14:25.552416 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 3/6] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Oct 6 12:14:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:14:28.140073 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-f56aa9d0-2f4f-4a91-9394-e778b5d6d5c6 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:14:28.141678 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-f56aa9d0-2f4f-4a91-9394-e778b5d6d5c6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002111 Oct 06 12:14:28.142737 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 4/7] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 12:14:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:14:28.822433 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-ab74eb38-c57d-4af3-8d3b-c3122387cb6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "id": "d1", "name": "ds512M", "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:28.861403 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-ab74eb38-c57d-4af3-8d3b-c3122387cb6f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.712581 Oct 06 12:14:28.862316 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 4/8] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 12:14:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:14:28.875333 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-90cb2955-47b5-48ec-9a2f-2754d9e20fc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:28.927052 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-90cb2955-47b5-48ec-9a2f-2754d9e20fc6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056613 Oct 06 12:14:28.927668 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 5/9] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Oct 6 12:14:28 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:14:31.501812 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-ab74eb38-c57d-4af3-8d3b-c3122387cb6f admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:14:31.502923 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-ab74eb38-c57d-4af3-8d3b-c3122387cb6f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Oct 06 12:14:31.503474 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 12:14:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:14:31.914187 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-566a8d7e-36f1-464f-aa12-407552bb911d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:31.933461 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-566a8d7e-36f1-464f-aa12-407552bb911d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.422763 Oct 06 12:14:31.934170 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 6/11] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 12:14:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 12:14:31.945918 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-c12b7b9d-fd75-4732-8dc7-c6971f747408 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:31.975192 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-c12b7b9d-fd75-4732-8dc7-c6971f747408 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032847 Oct 06 12:14:31.975874 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 6/12] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Oct 6 12:14:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:14:34.580841 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-566a8d7e-36f1-464f-aa12-407552bb911d admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:14:34.581759 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-566a8d7e-36f1-464f-aa12-407552bb911d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 06 12:14:34.582458 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 7/13] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 12:14:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:14:34.996525 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-6dddaf16-158e-4185-ad54-1cd22e1be034 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G"}} {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:35.018352 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-6dddaf16-158e-4185-ad54-1cd22e1be034 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429848 Oct 06 12:14:35.022064 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 7/14] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 12:14:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:14:35.032299 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-2bd94650-6159-4e1d-a547-63e9365e93e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:35.059860 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-2bd94650-6159-4e1d-a547-63e9365e93e9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031871 Oct 06 12:14:35.060756 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 8/15] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Oct 6 12:14:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:14:37.677922 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-6dddaf16-158e-4185-ad54-1cd22e1be034 admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:14:37.678992 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-6dddaf16-158e-4185-ad54-1cd22e1be034 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Oct 06 12:14:37.679422 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 8/16] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 12:14:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:14:38.103810 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-f86f044f-c2a0-457a-ac91-65c3fb4823db admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:38.123426 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-f86f044f-c2a0-457a-ac91-65c3fb4823db admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437638 Oct 06 12:14:38.124272 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 9/17] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 12:14:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:14:38.137333 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-3295049d-a81f-4412-a586-686e2482b1c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:38.167081 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-3295049d-a81f-4412-a586-686e2482b1c8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034313 Oct 06 12:14:38.167879 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 9/18] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Oct 6 12:14:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:14:40.779258 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-f86f044f-c2a0-457a-ac91-65c3fb4823db admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:14:40.780229 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-f86f044f-c2a0-457a-ac91-65c3fb4823db admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Oct 06 12:14:40.780630 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 10/19] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 12:14:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:14:41.193769 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-c01dbfe4-fcaf-4aeb-abe4-16fd74e92208 admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:14:41.221870 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-c01dbfe4-fcaf-4aeb-abe4-16fd74e92208 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.431065 Oct 06 12:14:41.222664 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 10/20] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Oct 6 12:14:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:14:44.239533 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-f86f044f-c2a0-457a-ac91-65c3fb4823db admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:14:44.240557 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-f86f044f-c2a0-457a-ac91-65c3fb4823db admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 06 12:14:44.240956 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 11/21] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 12:14:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:14:44.643184 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-3f96fd0a-b129-4efa-8087-eb986c3ab212 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "vcpus": 1, "swap": 0, "disk": 1}} {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:44.663643 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-3f96fd0a-b129-4efa-8087-eb986c3ab212 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.416496 Oct 06 12:14:44.664191 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 11/22] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 12:14:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 12:14:44.676840 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-3074050a-56ef-4c9e-9436-c52ec4109d2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:44.703815 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-3074050a-56ef-4c9e-9436-c52ec4109d2b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030667 Oct 06 12:14:44.704474 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 12/23] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Oct 6 12:14:44 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:14:47.269047 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-3f96fd0a-b129-4efa-8087-eb986c3ab212 admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:14:47.269950 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-3f96fd0a-b129-4efa-8087-eb986c3ab212 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 06 12:14:47.270822 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 12:14:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:14:47.681691 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-97ce1daf-d744-4119-a15e-14f6e4b2d413 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "id": "2", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:47.701415 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-97ce1daf-d744-4119-a15e-14f6e4b2d413 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424535 Oct 06 12:14:47.701971 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 13/25] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 12:14:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 12:14:47.714743 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-d77e3cac-f8b1-4d3f-b9f7-4a75d40c65eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:47.739890 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-d77e3cac-f8b1-4d3f-b9f7-4a75d40c65eb admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028901 Oct 06 12:14:47.740782 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 13/26] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Oct 6 12:14:47 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:14:50.337618 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-97ce1daf-d744-4119-a15e-14f6e4b2d413 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:14:50.338845 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-97ce1daf-d744-4119-a15e-14f6e4b2d413 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Oct 06 12:14:50.339318 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 14/27] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 12:14:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:14:50.774244 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-7d5b9a1a-6185-4837-9eae-46092add94d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 2, "swap": 0, "disk": 40, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:50.805326 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-7d5b9a1a-6185-4837-9eae-46092add94d6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.459352 Oct 06 12:14:50.806972 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 14/28] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 12:14:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:14:50.819027 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-62d4b46f-bd0c-4fba-947a-ec1ca2a72519 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:50.849894 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-62d4b46f-bd0c-4fba-947a-ec1ca2a72519 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034343 Oct 06 12:14:50.850581 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 15/29] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Oct 6 12:14:50 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:14:53.468415 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-7d5b9a1a-6185-4837-9eae-46092add94d6 admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:14:53.468415 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-7d5b9a1a-6185-4837-9eae-46092add94d6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 06 12:14:53.469129 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 15/30] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 12:14:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:14:53.918357 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-cf8f74ef-533c-4adc-8b43-a3796e078885 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "name": "m1.large", "vcpus": 4, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "swap": 0}} {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:53.924697 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG dbcounter [-] [105357] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:53.940269 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-cf8f74ef-533c-4adc-8b43-a3796e078885 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.464437 Oct 06 12:14:53.940820 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 16/31] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 12:14:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 12:14:53.952811 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-a5f980a5-cb66-4ce2-95ad-7ff18773baf1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:53.978811 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-a5f980a5-cb66-4ce2-95ad-7ff18773baf1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029633 Oct 06 12:14:53.979403 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 16/32] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Oct 6 12:14:53 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:14:56.581385 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-cf8f74ef-533c-4adc-8b43-a3796e078885 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:14:56.582308 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-cf8f74ef-533c-4adc-8b43-a3796e078885 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 06 12:14:56.582718 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 17/33] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 12:14:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:14:57.029098 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-60d161eb-b5db-4c2f-8254-d98caca5da86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384}} {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:57.035992 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG dbcounter [-] [105358] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:57.050803 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-60d161eb-b5db-4c2f-8254-d98caca5da86 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.462116 Oct 06 12:14:57.051355 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 17/34] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 12:14:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 12:14:57.063961 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-1a7a7298-ea03-458a-bc5a-976dfed2efea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:14:57.093849 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-1a7a7298-ea03-458a-bc5a-976dfed2efea admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033835 Oct 06 12:14:57.094894 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 18/35] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Oct 6 12:14:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:15:15.569825 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-60d161eb-b5db-4c2f-8254-d98caca5da86 admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:15.570850 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-60d161eb-b5db-4c2f-8254-d98caca5da86 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 06 12:15:15.571258 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 18/36] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 12:15:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:15:15.582408 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG dbcounter [-] [105357] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:15.956156 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-a68a473c-8fe4-447c-a35c-daf15906e958 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:15.975108 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-a68a473c-8fe4-447c-a35c-daf15906e958 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397564 Oct 06 12:15:15.975667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 19/37] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Oct 6 12:15:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:15:17.276212 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-60d161eb-b5db-4c2f-8254-d98caca5da86 admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:17.277216 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-60d161eb-b5db-4c2f-8254-d98caca5da86 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 06 12:15:17.277622 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 19/38] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 12:15:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:15:17.809097 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-bccad01d-e7a0-47cb-87ad-77150fff13da admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:17.814886 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.wsgi [None req-bccad01d-e7a0-47cb-87ad-77150fff13da admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-bccad01d-e7a0-47cb-87ad-77150fff13da admin admin] Request method failure captured: Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Accept: application/json Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Accept-Encoding: gzip, deflate Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Connection: keep-alive Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Content-Length: 0 Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Host: 10.222.0.33 Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Openstack-Api-Version: compute 2.92 Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Openstack-System-Scope: None Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: User-Agent: python-novaclient Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Auth-Token: gAAAAABjPsbV9cx2Moxzh2DNLgoRaLjvlvFOvDQ4BJWUX5mIcyIjgIqPQKFuARk4t8Nm1LwsNJaj9KvV9rM99EDwrkN8grE64eHEIU-H94gbx6LAg85HoQGTOf5tbcCTvMS8yD8abbyRy-LKcZh6YDBKROFHv-EW55J9ByUh8Jc5UmdP_NHidSc Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Domain-Id: None Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Domain-Name: None Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Identity-Status: Confirmed Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Is-Admin-Project: True Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Project-Domain-Id: default Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Project-Domain-Name: Default Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Project-Id: 5568e23a42b74b0a8d5f679d197b7521 Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Project-Name: admin Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Role: admin,member,reader Oct 06 12:15:17.818116 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Roles: admin,member,reader Oct 06 12:15:17.819876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5568e23a42b74b0a8d5f679d197b7521", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:15:17.819876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Tenant: admin Oct 06 12:15:17.819876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Tenant-Id: 5568e23a42b74b0a8d5f679d197b7521 Oct 06 12:15:17.819876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Tenant-Name: admin Oct 06 12:15:17.819876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-User: admin Oct 06 12:15:17.819876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-User-Domain-Id: default Oct 06 12:15:17.819876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-User-Domain-Name: Default Oct 06 12:15:17.819876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-User-Id: 50b3556af8274b8a9a59fe39e12271c7 Oct 06 12:15:17.819876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-User-Name: admin Oct 06 12:15:17.819876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: method: > Oct 06 12:15:17.819876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: exception: Flavor 42 could not be found. Oct 06 12:15:17.819876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: action_args: {'id': '42'} Oct 06 12:15:17.819876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:15:17.819876 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:15:17.821155 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Oct 06 12:15:17.822628 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-bccad01d-e7a0-47cb-87ad-77150fff13da admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:15:17.824045 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-bccad01d-e7a0-47cb-87ad-77150fff13da admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.390030 Oct 06 12:15:17.824045 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 20/39] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Oct 6 12:15:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:17.829338 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-a7081e5f-31a3-43c3-9076-6b5f6a95d762 admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:17.852360 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-a7081e5f-31a3-43c3-9076-6b5f6a95d762 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026600 Oct 06 12:15:17.852897 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 20/40] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Oct 6 12:15:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:15:17.866241 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-24e6925d-123a-4ad7-923a-39ffdb7e291b admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:17.891890 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-24e6925d-123a-4ad7-923a-39ffdb7e291b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.032962 Oct 06 12:15:17.892450 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 21/41] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Oct 6 12:15:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:15:17.902011 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-3354d1e2-9d45-4738-9c33-7f738856e356 admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:17.907408 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.wsgi [None req-3354d1e2-9d45-4738-9c33-7f738856e356 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-3354d1e2-9d45-4738-9c33-7f738856e356 admin admin] Request method failure captured: Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Accept: application/json Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Accept-Encoding: gzip, deflate Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Connection: keep-alive Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Content-Length: 0 Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Host: 10.222.0.33 Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Openstack-Api-Version: compute 2.92 Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Openstack-System-Scope: None Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: User-Agent: python-novaclient Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Auth-Token: gAAAAABjPsbV9cx2Moxzh2DNLgoRaLjvlvFOvDQ4BJWUX5mIcyIjgIqPQKFuARk4t8Nm1LwsNJaj9KvV9rM99EDwrkN8grE64eHEIU-H94gbx6LAg85HoQGTOf5tbcCTvMS8yD8abbyRy-LKcZh6YDBKROFHv-EW55J9ByUh8Jc5UmdP_NHidSc Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Domain-Id: None Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Domain-Name: None Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Identity-Status: Confirmed Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Is-Admin-Project: True Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Project-Domain-Id: default Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Project-Domain-Name: Default Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Project-Id: 5568e23a42b74b0a8d5f679d197b7521 Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Project-Name: admin Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Role: admin,member,reader Oct 06 12:15:17.911234 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Roles: admin,member,reader Oct 06 12:15:17.912826 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5568e23a42b74b0a8d5f679d197b7521", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:15:17.912826 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Tenant: admin Oct 06 12:15:17.912826 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Tenant-Id: 5568e23a42b74b0a8d5f679d197b7521 Oct 06 12:15:17.912826 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Tenant-Name: admin Oct 06 12:15:17.912826 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-User: admin Oct 06 12:15:17.912826 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-User-Domain-Id: default Oct 06 12:15:17.912826 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-User-Domain-Name: Default Oct 06 12:15:17.912826 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-User-Id: 50b3556af8274b8a9a59fe39e12271c7 Oct 06 12:15:17.912826 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-User-Name: admin Oct 06 12:15:17.912826 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: method: > Oct 06 12:15:17.912826 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: exception: Flavor 42 could not be found. Oct 06 12:15:17.912826 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: action_args: {'id': '42'} Oct 06 12:15:17.912826 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:15:17.912826 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:15:17.913750 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Oct 06 12:15:17.915299 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-3354d1e2-9d45-4738-9c33-7f738856e356 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:15:17.916590 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-3354d1e2-9d45-4738-9c33-7f738856e356 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014171 Oct 06 12:15:17.916590 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 21/42] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Oct 6 12:15:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 06 12:15:19.122360 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-24e6925d-123a-4ad7-923a-39ffdb7e291b admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:19.123368 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-24e6925d-123a-4ad7-923a-39ffdb7e291b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 06 12:15:19.123819 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 22/43] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 12:15:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:15:19.646384 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-efd02b35-4bb5-47af-b5af-e6d6af418830 admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:19.651661 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.wsgi [None req-efd02b35-4bb5-47af-b5af-e6d6af418830 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-efd02b35-4bb5-47af-b5af-e6d6af418830 admin admin] Request method failure captured: Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Accept: application/json Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Accept-Encoding: gzip, deflate Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Connection: keep-alive Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Content-Length: 0 Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Host: 10.222.0.33 Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Openstack-Api-Version: compute 2.92 Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Openstack-System-Scope: None Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: User-Agent: python-novaclient Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Auth-Token: gAAAAABjPsbX3GFpSrbS_5enWdkfF-8D6OYYsJ4Mx4obqHX9CpfY3p7gRyYzJENBy_EcaK9Kstssrb_hrdKrOlhIbeNG9NrHcf9NEb7jB2MOnK6bet9ikopGFFxa_tDDFfsplW-tdzzlK-olCzacntAk7Z1TfeKTrwnWaLlCAmxvtAUQSD434pw Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Domain-Id: None Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Domain-Name: None Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Identity-Status: Confirmed Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Is-Admin-Project: True Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Project-Domain-Id: default Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Project-Domain-Name: Default Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Project-Id: 5568e23a42b74b0a8d5f679d197b7521 Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Project-Name: admin Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Role: admin,member,reader Oct 06 12:15:19.653168 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Roles: admin,member,reader Oct 06 12:15:19.654688 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5568e23a42b74b0a8d5f679d197b7521", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:15:19.654688 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Tenant: admin Oct 06 12:15:19.654688 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Tenant-Id: 5568e23a42b74b0a8d5f679d197b7521 Oct 06 12:15:19.654688 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Tenant-Name: admin Oct 06 12:15:19.654688 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-User: admin Oct 06 12:15:19.654688 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-User-Domain-Id: default Oct 06 12:15:19.654688 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-User-Domain-Name: Default Oct 06 12:15:19.654688 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-User-Id: 50b3556af8274b8a9a59fe39e12271c7 Oct 06 12:15:19.654688 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-User-Name: admin Oct 06 12:15:19.654688 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: method: > Oct 06 12:15:19.654688 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: exception: Flavor 84 could not be found. Oct 06 12:15:19.654688 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: action_args: {'id': '84'} Oct 06 12:15:19.654688 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:15:19.654688 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:15:19.655706 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Oct 06 12:15:19.657185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-efd02b35-4bb5-47af-b5af-e6d6af418830 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:15:19.658513 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-efd02b35-4bb5-47af-b5af-e6d6af418830 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.393915 Oct 06 12:15:19.658513 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 22/44] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Oct 6 12:15:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:19.664443 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-706702c5-cdb3-41b2-9039-4c976ed69c59 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:19.679108 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-706702c5-cdb3-41b2-9039-4c976ed69c59 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018209 Oct 06 12:15:19.679658 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 23/45] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Oct 6 12:15:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:15:19.688747 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-6895d7f6-e788-4f26-9617-2d08d4c7ddcf admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:19.704147 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-6895d7f6-e788-4f26-9617-2d08d4c7ddcf admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018869 Oct 06 12:15:19.705180 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Oct 6 12:15:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:15:19.714117 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-cc8092ab-9e1a-4e14-af18-41582f4aa6b5 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:19.718961 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.wsgi [None req-cc8092ab-9e1a-4e14-af18-41582f4aa6b5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-cc8092ab-9e1a-4e14-af18-41582f4aa6b5 admin admin] Request method failure captured: Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Accept: application/json Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Accept-Encoding: gzip, deflate Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Connection: keep-alive Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Content-Length: 0 Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Host: 10.222.0.33 Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Openstack-Api-Version: compute 2.92 Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Openstack-System-Scope: None Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: User-Agent: python-novaclient Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Auth-Token: gAAAAABjPsbX3GFpSrbS_5enWdkfF-8D6OYYsJ4Mx4obqHX9CpfY3p7gRyYzJENBy_EcaK9Kstssrb_hrdKrOlhIbeNG9NrHcf9NEb7jB2MOnK6bet9ikopGFFxa_tDDFfsplW-tdzzlK-olCzacntAk7Z1TfeKTrwnWaLlCAmxvtAUQSD434pw Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Domain-Id: None Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Domain-Name: None Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Identity-Status: Confirmed Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Is-Admin-Project: True Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Project-Domain-Id: default Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Project-Domain-Name: Default Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Project-Id: 5568e23a42b74b0a8d5f679d197b7521 Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Project-Name: admin Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Role: admin,member,reader Oct 06 12:15:19.720477 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Roles: admin,member,reader Oct 06 12:15:19.722073 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5568e23a42b74b0a8d5f679d197b7521", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:15:19.722073 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Tenant: admin Oct 06 12:15:19.722073 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Tenant-Id: 5568e23a42b74b0a8d5f679d197b7521 Oct 06 12:15:19.722073 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Tenant-Name: admin Oct 06 12:15:19.722073 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-User: admin Oct 06 12:15:19.722073 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-User-Domain-Id: default Oct 06 12:15:19.722073 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-User-Domain-Name: Default Oct 06 12:15:19.722073 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-User-Id: 50b3556af8274b8a9a59fe39e12271c7 Oct 06 12:15:19.722073 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-User-Name: admin Oct 06 12:15:19.722073 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: method: > Oct 06 12:15:19.722073 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: exception: Flavor 84 could not be found. Oct 06 12:15:19.722073 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: action_args: {'id': '84'} Oct 06 12:15:19.722073 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:15:19.722073 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:15:19.723296 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Oct 06 12:15:19.724667 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-cc8092ab-9e1a-4e14-af18-41582f4aa6b5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:15:19.725899 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-cc8092ab-9e1a-4e14-af18-41582f4aa6b5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011102 Oct 06 12:15:19.725899 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 24/47] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Oct 6 12:15:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:20.951443 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-6895d7f6-e788-4f26-9617-2d08d4c7ddcf admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:20.952479 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-6895d7f6-e788-4f26-9617-2d08d4c7ddcf admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 06 12:15:20.952875 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 24/48] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 12:15:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:15:21.585092 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-c4765b41-79e3-4ee3-8f35-ff9528da3972 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:21.591005 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.wsgi [None req-c4765b41-79e3-4ee3-8f35-ff9528da3972 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-c4765b41-79e3-4ee3-8f35-ff9528da3972 admin admin] Request method failure captured: Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Accept: application/json Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Accept-Encoding: gzip, deflate Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Connection: keep-alive Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Content-Length: 0 Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Host: 10.222.0.33 Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Openstack-Api-Version: compute 2.92 Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Openstack-System-Scope: None Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: User-Agent: python-novaclient Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Auth-Token: gAAAAABjPsbYu0zfX0CNZhkY98WItP4O02SHkMCJglcHn5HxVMwCxFjdvB2_5V-tjGMaj8w6oUXxoGLf55oHPwhK_8TjkrCSwOwM2iX7vQ9DsG8_72AitrcL-wX75KUObYFnuwJF5g4QCH7um-U5TpFU3kmEI5XwKBeSks74Ubt1f1onBkPSQWA Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Domain-Id: None Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Domain-Name: None Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Identity-Status: Confirmed Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Is-Admin-Project: True Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Project-Domain-Id: default Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Project-Domain-Name: Default Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Project-Id: 5568e23a42b74b0a8d5f679d197b7521 Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Project-Name: admin Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Role: admin,member,reader Oct 06 12:15:21.592543 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Roles: admin,member,reader Oct 06 12:15:21.594132 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5568e23a42b74b0a8d5f679d197b7521", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:15:21.594132 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Tenant: admin Oct 06 12:15:21.594132 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Tenant-Id: 5568e23a42b74b0a8d5f679d197b7521 Oct 06 12:15:21.594132 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-Tenant-Name: admin Oct 06 12:15:21.594132 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-User: admin Oct 06 12:15:21.594132 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-User-Domain-Id: default Oct 06 12:15:21.594132 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-User-Domain-Name: Default Oct 06 12:15:21.594132 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-User-Id: 50b3556af8274b8a9a59fe39e12271c7 Oct 06 12:15:21.594132 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: X-User-Name: admin Oct 06 12:15:21.594132 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: method: > Oct 06 12:15:21.594132 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: exception: Flavor 451 could not be found. Oct 06 12:15:21.594132 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: action_args: {'id': '451'} Oct 06 12:15:21.594132 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:15:21.594132 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:15:21.595118 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: ERROR nova.api.openstack.wsgi Oct 06 12:15:21.596882 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-c4765b41-79e3-4ee3-8f35-ff9528da3972 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:15:21.597954 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-c4765b41-79e3-4ee3-8f35-ff9528da3972 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.501924 Oct 06 12:15:21.597954 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 25/49] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Oct 6 12:15:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 503 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:21.604123 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-beee59d6-1de1-4e48-a019-b9d15ddaa493 admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:21.618794 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-beee59d6-1de1-4e48-a019-b9d15ddaa493 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018180 Oct 06 12:15:21.619334 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 25/50] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Oct 6 12:15:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:15:21.628817 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-a554ae1e-8bd9-4b54-bf92-77a26a7c5e32 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:21.643975 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-a554ae1e-8bd9-4b54-bf92-77a26a7c5e32 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019138 Oct 06 12:15:21.644496 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 26/51] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Oct 6 12:15:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:15:21.653818 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-ee5b64a5-4cfc-4a08-ac4c-836a3a49e160 admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:21.658593 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.wsgi [None req-ee5b64a5-4cfc-4a08-ac4c-836a3a49e160 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-ee5b64a5-4cfc-4a08-ac4c-836a3a49e160 admin admin] Request method failure captured: Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Accept: application/json Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Accept-Encoding: gzip, deflate Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Connection: keep-alive Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Content-Length: 0 Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Host: 10.222.0.33 Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Openstack-Api-Version: compute 2.92 Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Openstack-System-Scope: None Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: User-Agent: python-novaclient Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Auth-Token: gAAAAABjPsbYu0zfX0CNZhkY98WItP4O02SHkMCJglcHn5HxVMwCxFjdvB2_5V-tjGMaj8w6oUXxoGLf55oHPwhK_8TjkrCSwOwM2iX7vQ9DsG8_72AitrcL-wX75KUObYFnuwJF5g4QCH7um-U5TpFU3kmEI5XwKBeSks74Ubt1f1onBkPSQWA Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Domain-Id: None Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Domain-Name: None Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Identity-Status: Confirmed Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Is-Admin-Project: True Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Project-Domain-Id: default Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Project-Domain-Name: Default Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Project-Id: 5568e23a42b74b0a8d5f679d197b7521 Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Project-Name: admin Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Role: admin,member,reader Oct 06 12:15:21.660249 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Roles: admin,member,reader Oct 06 12:15:21.661795 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5568e23a42b74b0a8d5f679d197b7521", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5568e23a42b74b0a8d5f679d197b7521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:15:21.661795 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Tenant: admin Oct 06 12:15:21.661795 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Tenant-Id: 5568e23a42b74b0a8d5f679d197b7521 Oct 06 12:15:21.661795 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-Tenant-Name: admin Oct 06 12:15:21.661795 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-User: admin Oct 06 12:15:21.661795 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-User-Domain-Id: default Oct 06 12:15:21.661795 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-User-Domain-Name: Default Oct 06 12:15:21.661795 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-User-Id: 50b3556af8274b8a9a59fe39e12271c7 Oct 06 12:15:21.661795 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: X-User-Name: admin Oct 06 12:15:21.661795 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: method: > Oct 06 12:15:21.661795 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: exception: Flavor 451 could not be found. Oct 06 12:15:21.661795 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: action_args: {'id': '451'} Oct 06 12:15:21.661795 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:15:21.661795 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:15:21.662768 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: ERROR nova.api.openstack.wsgi Oct 06 12:15:21.664133 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-ee5b64a5-4cfc-4a08-ac4c-836a3a49e160 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:15:21.665395 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-ee5b64a5-4cfc-4a08-ac4c-836a3a49e160 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011228 Oct 06 12:15:21.665395 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 26/52] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Oct 6 12:15:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:22.868808 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-a554ae1e-8bd9-4b54-bf92-77a26a7c5e32 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:22.869821 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-a554ae1e-8bd9-4b54-bf92-77a26a7c5e32 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 06 12:15:22.870202 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 27/53] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 12:15:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:15:23.387145 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-d73c9073-ff90-445f-b23a-ad4918de2c37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:15:23.406747 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-d73c9073-ff90-445f-b23a-ad4918de2c37 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.400765 Oct 06 12:15:23.407205 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 27/54] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Oct 6 12:15:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 12:15:24.629199 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-a554ae1e-8bd9-4b54-bf92-77a26a7c5e32 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:24.630266 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-a554ae1e-8bd9-4b54-bf92-77a26a7c5e32 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 06 12:15:24.630662 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 12:15:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:15:25.142659 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-d04ea1f3-2d8e-4b58-a905-7593ef7131d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:15:25.161072 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-d04ea1f3-2d8e-4b58-a905-7593ef7131d8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.394813 Oct 06 12:15:25.161608 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 28/56] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Oct 6 12:15:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 12:15:26.389728 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-a554ae1e-8bd9-4b54-bf92-77a26a7c5e32 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:26.390747 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-a554ae1e-8bd9-4b54-bf92-77a26a7c5e32 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 06 12:15:26.391174 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 29/57] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 12:15:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:15:27.034203 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-29089056-b66f-454e-8009-ed44e360706a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:15:27.053410 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-29089056-b66f-454e-8009-ed44e360706a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.524964 Oct 06 12:15:27.053896 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 29/58] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Oct 6 12:15:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:15:28.276695 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-a554ae1e-8bd9-4b54-bf92-77a26a7c5e32 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:28.277694 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-a554ae1e-8bd9-4b54-bf92-77a26a7c5e32 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 06 12:15:28.278092 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 30/59] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 12:15:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:15:28.796829 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-6f36ff21-08a6-4bb9-b7cd-23d843b5b49b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:15:28.815988 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-6f36ff21-08a6-4bb9-b7cd-23d843b5b49b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.399307 Oct 06 12:15:28.816533 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 30/60] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Oct 6 12:15:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:15:30.028021 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-a554ae1e-8bd9-4b54-bf92-77a26a7c5e32 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:30.029033 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-a554ae1e-8bd9-4b54-bf92-77a26a7c5e32 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 06 12:15:30.029432 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 31/61] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 12:15:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:15:30.544874 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-5d50cffc-6546-4c9d-a4ed-9784f6ed564d admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:15:30.564978 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-5d50cffc-6546-4c9d-a4ed-9784f6ed564d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.397865 Oct 06 12:15:30.565512 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 31/62] 10.222.0.33 () {60 vars in 1202 bytes} [Thu Oct 6 12:15:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:16:26.729696 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-a554ae1e-8bd9-4b54-bf92-77a26a7c5e32 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:16:26.730763 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-a554ae1e-8bd9-4b54-bf92-77a26a7c5e32 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Oct 06 12:16:26.731165 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 32/63] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 12:16:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:16:26.742262 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG dbcounter [-] [105358] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:27.117895 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-c5f16ac4-674f-45d7-ad49-cf18c131073e admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:16:27.138516 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-c5f16ac4-674f-45d7-ad49-cf18c131073e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401305 Oct 06 12:16:27.139052 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 32/64] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Oct 6 12:16:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:16:27.160913 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG dbcounter [-] [105357] Writing DB stats nova_api:SELECT=14 {{(pid=105357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:27.164685 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-7743249d-fc07-42d8-916c-aa99fb84f381 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:16:27.172158 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-7743249d-fc07-42d8-916c-aa99fb84f381 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012860 Oct 06 12:16:27.172822 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 33/65] 10.222.0.33 () {60 vars in 1283 bytes} [Thu Oct 6 12:16:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:16:27.183785 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-69d7a6bd-4c2e-43fd-9d17-4b7478f568d3 admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:16:27.191447 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-69d7a6bd-4c2e-43fd-9d17-4b7478f568d3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011135 Oct 06 12:16:27.191994 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 33/66] 10.222.0.33 () {60 vars in 1286 bytes} [Thu Oct 6 12:16:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:16:27.202842 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-de18fd74-7b50-47ce-a018-be1849da7b89 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:16:27.210405 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-de18fd74-7b50-47ce-a018-be1849da7b89 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011064 Oct 06 12:16:27.210916 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 34/67] 10.222.0.33 () {60 vars in 1286 bytes} [Thu Oct 6 12:16:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:16:27.221841 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-bc808108-8a9d-4d25-b2fb-10663bd54322 admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:16:27.228820 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-bc808108-8a9d-4d25-b2fb-10663bd54322 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010314 Oct 06 12:16:27.229326 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 34/68] 10.222.0.33 () {60 vars in 1283 bytes} [Thu Oct 6 12:16:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:19:59.570675 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-de18fd74-7b50-47ce-a018-be1849da7b89 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:19:59.571704 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-de18fd74-7b50-47ce-a018-be1849da7b89 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 06 12:19:59.572090 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 35/69] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 12:19:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:19:59.711059 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG dbcounter [-] [105358] Writing DB stats nova_api:SELECT=6 {{(pid=105358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:19:59.864388 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-4969b3a9-44e4-4f14-8940-69957cdbcc4b admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:19:59.869000 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-4969b3a9-44e4-4f14-8940-69957cdbcc4b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:19:59.869466 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-4969b3a9-44e4-4f14-8940-69957cdbcc4b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:19:59.869889 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-4969b3a9-44e4-4f14-8940-69957cdbcc4b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:19:59.870592 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-4969b3a9-44e4-4f14-8940-69957cdbcc4b admin admin] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:19:59.871040 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-4969b3a9-44e4-4f14-8940-69957cdbcc4b admin admin] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:19:59.871453 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-4969b3a9-44e4-4f14-8940-69957cdbcc4b admin admin] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:19:59.903014 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-4969b3a9-44e4-4f14-8940-69957cdbcc4b admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.193080 Oct 06 12:19:59.903580 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 35/70] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Oct 6 12:19:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:20:00.970871 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-de18fd74-7b50-47ce-a018-be1849da7b89 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:20:00.971970 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-de18fd74-7b50-47ce-a018-be1849da7b89 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002210 Oct 06 12:20:00.972372 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 36/71] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 12:20:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:20:01.166525 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-493b0ead-4b25-4063-b676-9467c34a884a admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:20:01.170095 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-493b0ead-4b25-4063-b676-9467c34a884a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:20:01.170646 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-493b0ead-4b25-4063-b676-9467c34a884a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:20:01.171185 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-493b0ead-4b25-4063-b676-9467c34a884a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:20:01.171997 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-493b0ead-4b25-4063-b676-9467c34a884a admin admin] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:20:01.172520 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-493b0ead-4b25-4063-b676-9467c34a884a admin admin] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:20:01.173020 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-493b0ead-4b25-4063-b676-9467c34a884a admin admin] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:20:01.192929 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-493b0ead-4b25-4063-b676-9467c34a884a admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078471 Oct 06 12:20:01.193420 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 36/72] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Oct 6 12:20:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:20:12.688504 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-de18fd74-7b50-47ce-a018-be1849da7b89 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:20:12.689511 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-de18fd74-7b50-47ce-a018-be1849da7b89 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Oct 06 12:20:12.689901 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 37/73] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 12:20:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:20:12.830340 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG dbcounter [-] [105358] Writing DB stats nova_cell0:SELECT=4 {{(pid=105358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:20:12.831048 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG dbcounter [-] [105358] Writing DB stats nova_cell1:SELECT=4 {{(pid=105358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:20:12.831680 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG dbcounter [-] [105358] Writing DB stats nova_api:SELECT=8 {{(pid=105358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:20:12.879493 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-9d9f7c5e-d4a2-47c2-a9bb-7a1606fd2f84 admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:20:12.882847 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-9d9f7c5e-d4a2-47c2-a9bb-7a1606fd2f84 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:20:12.883320 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-9d9f7c5e-d4a2-47c2-a9bb-7a1606fd2f84 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:20:12.883775 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-9d9f7c5e-d4a2-47c2-a9bb-7a1606fd2f84 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:20:12.884484 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-9d9f7c5e-d4a2-47c2-a9bb-7a1606fd2f84 admin admin] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:20:12.884923 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-9d9f7c5e-d4a2-47c2-a9bb-7a1606fd2f84 admin admin] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:20:12.885335 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-9d9f7c5e-d4a2-47c2-a9bb-7a1606fd2f84 admin admin] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:20:12.910956 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-9d9f7c5e-d4a2-47c2-a9bb-7a1606fd2f84 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085378 Oct 06 12:20:12.911434 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 37/74] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Oct 6 12:20:12 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:20:13.982549 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG nova.api.openstack.wsgi [None req-de18fd74-7b50-47ce-a018-be1849da7b89 admin admin] Calling method '>' {{(pid=105357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:20:13.983577 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: INFO nova.api.openstack.requestlog [None req-de18fd74-7b50-47ce-a018-be1849da7b89 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 06 12:20:13.983978 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: [pid: 105357|app: 0|req: 38/75] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 12:20:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:20:14.171809 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG nova.api.openstack.wsgi [None req-2827eb07-98ad-4d3c-a795-38aef5a37437 admin admin] Calling method '>' {{(pid=105358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:20:14.175176 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-2827eb07-98ad-4d3c-a795-38aef5a37437 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:20:14.175677 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-2827eb07-98ad-4d3c-a795-38aef5a37437 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:20:14.176101 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-2827eb07-98ad-4d3c-a795-38aef5a37437 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:20:14.176825 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-2827eb07-98ad-4d3c-a795-38aef5a37437 admin admin] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:20:14.177268 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-2827eb07-98ad-4d3c-a795-38aef5a37437 admin admin] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:20:14.177678 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: DEBUG oslo_concurrency.lockutils [None req-2827eb07-98ad-4d3c-a795-38aef5a37437 admin admin] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:20:14.199138 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: INFO nova.api.openstack.requestlog [None req-2827eb07-98ad-4d3c-a795-38aef5a37437 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.078082 Oct 06 12:20:14.199633 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: [pid: 105358|app: 0|req: 38/76] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Oct 6 12:20:14 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:21:12.309969 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: Thu Oct 6 12:21:12 2022 - graceful shutdown triggered... Oct 06 12:21:12.310112 dv-cinder-856041-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 06 12:21:12.311102 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: Gracefully killing worker 1 (pid: 105357)... Oct 06 12:21:12.311580 dv-cinder-856041-2-iscsi devstack@n-api.service[105358]: Gracefully killing worker 2 (pid: 105358)... Oct 06 12:21:12.437826 dv-cinder-856041-2-iscsi devstack@n-api.service[105357]: DEBUG dbcounter [-] [105357] Writing DB stats nova_api:SELECT=4 {{(pid=105357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:21:13.311616 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: worker 1 buried after 1 seconds Oct 06 12:21:13.312083 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: worker 2 buried after 1 seconds Oct 06 12:21:13.312083 dv-cinder-856041-2-iscsi devstack@n-api.service[105356]: goodbye to uWSGI. Oct 06 12:21:13.313120 dv-cinder-856041-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 06 12:21:13.313657 dv-cinder-856041-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 06 12:21:13.316383 dv-cinder-856041-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 06 12:21:13.332517 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 06 12:21:13.334497 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 6 12:21:13 2022] *** Oct 06 12:21:13.334497 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 06 12:21:13.334497 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 06 12:21:13.334497 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: nodename: dv-cinder-856041-2-iscsi Oct 06 12:21:13.334497 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: machine: x86_64 Oct 06 12:21:13.334497 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: clock source: unix Oct 06 12:21:13.334497 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: pcre jit disabled Oct 06 12:21:13.334497 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: detected number of CPU cores: 4 Oct 06 12:21:13.334497 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: current working directory: / Oct 06 12:21:13.334497 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: detected binary path: /usr/bin/uwsgi-core Oct 06 12:21:13.335306 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: your processes number limit is 47680 Oct 06 12:21:13.335306 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: your memory page size is 4096 bytes Oct 06 12:21:13.335306 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: detected max file descriptor number: 2048 Oct 06 12:21:13.335306 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: lock engine: pthread robust mutexes Oct 06 12:21:13.335306 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: thunder lock: enabled Oct 06 12:21:13.335306 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 06 12:21:13.335306 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 06 12:21:13.374402 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: Python main interpreter initialized at 0x55d59c03c9c0 Oct 06 12:21:13.374402 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: python threads support enabled Oct 06 12:21:13.374402 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: your server socket listen backlog is limited to 100 connections Oct 06 12:21:13.374402 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: your mercy for graceful operations on workers is 90 seconds Oct 06 12:21:13.374865 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: mapped 403077 bytes (393 KB) for 2 cores Oct 06 12:21:13.374865 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: *** Operational MODE: preforking *** Oct 06 12:21:13.375128 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: *** uWSGI is running in multiple interpreter mode *** Oct 06 12:21:13.375128 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: spawned uWSGI master process (pid: 120493) Oct 06 12:21:13.383825 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: spawned uWSGI worker 1 (pid: 120508, cores: 1) Oct 06 12:21:13.383825 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: spawned uWSGI worker 2 (pid: 120509, cores: 1) Oct 06 12:21:13.383825 dv-cinder-856041-2-iscsi devstack@n-api.service[120493]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 06 12:21:13.375322 dv-cinder-856041-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 06 12:21:14.042118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 12:21:14.050548 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 12:21:15.197193 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:21:15.197193 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: from cryptography.utils import int_from_bytes Oct 06 12:21:15.197867 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:21:15.197867 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: from cryptography.utils import int_from_bytes Oct 06 12:21:15.209390 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:21:15.209390 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: from cryptography.utils import int_from_bytes Oct 06 12:21:15.209845 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:21:15.209845 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: from cryptography.utils import int_from_bytes Oct 06 12:21:17.616846 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 12:21:17.617348 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 12:21:17.617676 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 12:21:17.618049 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 12:21:17.618309 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 12:21:17.618707 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.619040 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.619368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.619726 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.620065 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.620382 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.620714 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.621042 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.621375 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.621640 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.621962 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.622462 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856041-2-iscsi {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.622793 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.623125 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.623433 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.623790 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.624105 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.624971 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.625286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.625795 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.627108 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.627108 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.627108 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.627523 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.627789 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.628102 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.628430 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.628748 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.629087 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.629407 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.629821 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856041-2-iscsi {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.630150 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.630471 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.630794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.631246 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.631618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.631912 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.632230 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.632550 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.632870 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.633211 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.633534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.633861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.634188 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.634498 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.634859 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.635124 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.635449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.635814 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.636113 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.636367 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.636686 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.637015 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.637342 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.637671 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.637925 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.638178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.638503 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.638829 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.639143 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.639458 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.639800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.640704 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.641022 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.641334 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.641645 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.641956 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.642286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.642604 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.642936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.643263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.643600 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.644035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.644290 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.644605 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.644955 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.645341 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.645663 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.645991 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.646320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.646639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.646952 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.647266 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.647617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.647951 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.648262 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.648519 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.648826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.649141 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.649464 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.649819 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.650089 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.650404 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.650709 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.651023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.651335 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.651672 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.651980 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.652300 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.652610 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.652922 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.653238 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.653548 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.653858 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.654192 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.654518 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.656039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.656039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.656039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.656501 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.656501 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.656785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.657326 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.657502 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.657661 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.657966 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.658287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.658599 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.658914 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.659237 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.660192 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.660192 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.660192 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.660639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.660794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.661076 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.661386 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.661696 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.662006 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.662315 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.662622 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.662925 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.663333 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.663598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.663920 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.664280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.664713 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.664904 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.665215 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.665597 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.665901 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.666221 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.666556 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.666894 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.667320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.667550 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.668033 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.668193 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.668507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.668820 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.669178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.669453 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.669929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.670274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.670598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.670919 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.671275 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.671618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.671946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.672278 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.672611 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.672926 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.673273 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.673625 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.673946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.674275 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.674606 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.674923 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.675242 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.675581 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.675934 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.676255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.676577 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.676903 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.677223 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.677553 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.677729 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 12:21:17.678174 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.678285 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 12:21:17.678380 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.678480 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.678575 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 12:21:17.678785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.678888 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 12:21:17.679101 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.679206 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 12:21:17.679443 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.679581 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.679792 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.679909 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.680123 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.680243 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.680447 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.680546 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.680766 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.680871 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.681091 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.681194 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.681410 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.681503 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.681728 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.681838 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.682045 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.682140 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.682311 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.682416 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.682637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.682738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.682944 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.683095 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856041-2-iscsi {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.683258 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.683429 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.683592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.683785 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.683921 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.684112 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.684256 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.684441 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.684612 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.684755 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.684959 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.685115 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.685275 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.685399 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.685592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.685912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.686029 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.686226 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.686319 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.686536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.686639 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.687392 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.687554 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.687737 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.687868 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.688055 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.688176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.688381 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.688531 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.688699 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.688848 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.689012 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.689114 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.689341 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.689442 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.689650 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.689761 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.689961 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.690054 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856041-2-iscsi {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.690281 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.690374 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.690595 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.690698 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.690913 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.691007 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.691231 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.691469 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.691615 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.691707 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.691887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.692013 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.692255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.692363 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.692613 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.692750 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.695539 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.695670 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.695670 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.695974 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.695974 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.696143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.696143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.696295 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.696370 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.696521 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.696604 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.696677 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.696747 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.696825 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.696903 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.696983 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.697061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.697139 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.697217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.697289 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.697367 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.697444 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.697522 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.697593 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.697670 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.697751 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.697838 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.697916 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.697993 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.698071 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.698149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.698232 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.698312 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.698385 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.698479 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.698569 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.698656 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.698758 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.698835 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.698913 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.698991 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.699070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.699241 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.699350 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.699651 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.699875 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.700007 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.700146 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.700328 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.700469 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.700681 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.700833 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.700987 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.701129 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.701289 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.701453 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.701614 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.701766 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.701917 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.702076 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.702229 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.702439 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.703101 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.703243 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.703422 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.703615 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.703840 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.703986 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.704157 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.704322 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.704507 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.704756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.704932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.705570 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.705728 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.705728 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.706007 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.706151 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.706277 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.706373 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.706507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.706611 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.706709 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.707008 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.707120 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.707211 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.707453 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.707596 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.707728 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.707879 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.708014 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.708134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.708270 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.708411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.708538 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.708682 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.708816 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.708969 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.709187 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.709332 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.709509 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.709622 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.709881 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.710088 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.710193 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.710337 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.710550 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.710801 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.710948 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.711080 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.711195 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.711358 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.711493 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.711697 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.711831 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.712008 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.712111 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.712325 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.712434 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.712642 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.712745 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.712956 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.713059 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.713272 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.713375 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.713584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.713677 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.713902 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.714048 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.714231 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.714345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.714550 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.714645 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.714873 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.714973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.715185 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.715329 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.715498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.715665 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.715835 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.715938 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.716145 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.716281 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.716457 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.716568 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.716771 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.717250 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.717448 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.717593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.717767 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.717912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.718111 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.718258 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.718424 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.718590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.718744 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.718910 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.719058 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.719220 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.719437 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.719579 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.719737 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.719845 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.720055 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.720193 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.720382 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.720518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.720698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.720804 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.721024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.721128 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.721350 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.721456 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.721659 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.721757 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.721969 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.722070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.722285 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.722387 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.722596 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.722690 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.722903 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.723004 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.723209 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.723310 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.723530 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.723651 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.723883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.723983 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.724196 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.724297 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.724504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.724607 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.724823 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.724916 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.725147 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.725252 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:21:17.725464 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.725558 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.725787 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.725880 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.726102 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.726205 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.726460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.726638 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.726804 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.726978 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.727145 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.727306 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.727474 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.727656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.727977 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.728080 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.728297 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.728398 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.728613 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.728714 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.728929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.729024 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.729310 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.729434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.729632 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.729758 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.729966 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.730098 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.730298 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.730429 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.730605 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.730734 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.730923 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.731053 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.731244 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.731375 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.731989 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.732165 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.732325 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.732483 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.732655 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.732801 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.732955 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.733101 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.733247 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.733407 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.733562 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.733750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.733898 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.734057 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.734289 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.734612 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.734925 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.735054 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.735244 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.735355 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.735574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.735772 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.736122 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.736457 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.736788 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.736944 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.737121 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.737287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.737483 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.737752 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.737862 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.738087 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.738189 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.738412 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.738514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.738741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.738845 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.739063 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.739158 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.739383 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.739485 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.739735 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.739848 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.740061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.740163 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.740387 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.740481 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.740703 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.740804 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.741030 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.741131 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.741347 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.741455 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.741683 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.742020 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.742020 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.742194 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.742288 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.742385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.742600 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.742715 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.742908 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.743010 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.743246 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.743347 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.743586 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.743697 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.743904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.744051 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.744221 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.744366 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.744536 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.744641 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.744863 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.744958 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.745179 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.745284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.745512 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.745614 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.745824 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.745924 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.746136 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.746244 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.746447 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.746582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.746765 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.746901 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.747080 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.747187 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.747392 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.747493 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.747749 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.747854 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.748067 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.748171 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.748380 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.748479 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.748695 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.748789 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.749004 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.749098 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.749858 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.749962 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.750168 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.750263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.750485 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.750585 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.750800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.750900 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.751109 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.751211 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.751419 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.751535 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.751763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.751857 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.752108 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.752277 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.752373 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.752461 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.752678 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.752791 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.752986 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.753098 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.753306 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.753401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.753616 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.753721 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.753924 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.754033 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.754232 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.754336 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.754547 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.754647 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.754862 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.754968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.755170 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.755265 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.755498 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.755641 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.755855 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.755957 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.756166 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.756260 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.756477 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.756596 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.756792 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.756947 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.757095 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.757197 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.757409 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.757502 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.757720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.757821 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.758028 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.758126 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.758343 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.758437 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.758647 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.758753 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.758957 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.759051 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.759263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.759366 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.759595 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.759745 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.759887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.760029 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.760202 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.760349 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.760509 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.760645 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.760814 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.760959 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.761120 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.761269 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.761432 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.761575 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.761741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.761883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.762143 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.762295 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.762435 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.762568 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.762794 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.762943 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.763089 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.763396 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.763751 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.764074 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.764444 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.764609 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.764768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.764965 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.765613 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.765810 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.765977 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.766131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.766286 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.766502 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.766662 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.766810 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.766962 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.767151 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.767310 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.767484 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.767671 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.767829 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.767982 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.768148 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.768296 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.768441 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.768584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.768763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.768925 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.769082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.769228 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.769403 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.769565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.769712 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.769858 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.770013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.770171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.770316 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.770461 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.770640 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.770814 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.770976 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.771212 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.771362 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.771568 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.771722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.771888 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.772056 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.772237 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.772468 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.772627 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.772783 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.773035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.773201 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.773348 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.773450 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.773539 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.773699 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.773818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.773911 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.774059 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.774155 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.774382 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.774519 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.774704 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.774801 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.775026 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.775123 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.775347 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.775451 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.775696 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.775793 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.776029 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.776131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.776352 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.776533 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.776677 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.776772 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.776995 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.777089 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.777312 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.777460 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.777636 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.777787 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.777951 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.778099 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.778269 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.778458 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.778591 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.778716 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.778905 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.779029 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.779230 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.779334 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.779571 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.779682 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.779889 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.780104 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.780497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.780802 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.781115 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.781269 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.781445 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.781551 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.781762 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.781857 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.782097 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.782192 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.782413 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.782731 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.782903 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.783178 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.783281 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.783377 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.783696 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.783815 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.784010 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.784112 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.784326 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.784495 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.784688 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.784857 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.785011 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.785234 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.785335 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.785569 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.785672 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.785886 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.785992 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.786200 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.786294 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.786522 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.786624 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.786856 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.786952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.787176 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.787271 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.787489 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.787627 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.787824 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.787918 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.788154 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.788254 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.788466 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.788618 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.788787 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.788923 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.789108 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.789205 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.789429 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.789534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.789762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.789857 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.790085 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.790220 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.790408 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.790543 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.790729 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.790865 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.791044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.791191 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.791365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.791534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.791723 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.791928 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.792241 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.792341 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.792567 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.792722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.792886 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.792990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.793219 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.793333 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.793548 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.793644 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.793868 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.793976 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.794190 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.794287 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.794504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.794599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.794838 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.794943 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.795171 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.795266 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.795493 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.795606 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.795853 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.795965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.796189 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.796287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.796514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.796610 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.796831 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.796939 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.797147 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.797242 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.797463 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.797566 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.797785 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.797880 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.798100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.798207 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.798412 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.798508 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.798726 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.798822 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.799041 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.799143 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.799367 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.799469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.799711 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.799809 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.800035 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.800146 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.800350 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.800445 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.800672 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.800766 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.800982 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.801084 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.801294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.801406 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.801604 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.801749 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.801917 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.802015 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.802241 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.802348 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.802561 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.802691 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.802887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.802990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.803227 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.803377 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.803546 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.803644 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.803880 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.803978 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.804195 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.804302 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.804506 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.804609 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.804816 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.804911 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.805125 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.805220 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.805435 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.805530 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.805756 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.805915 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.806075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.806858 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.807043 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.807194 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.807342 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.807342 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.807675 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.807846 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.808000 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.808157 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.808302 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.808447 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.808668 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.808825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.808982 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.809127 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.809280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.809435 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.809591 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.809737 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.809882 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.810026 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.810179 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.810352 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.810507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.810659 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.810765 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.810765 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.811027 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.811178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.811418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.811583 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.812279 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.812430 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.812595 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.812742 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.813051 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.813196 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.813337 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.813471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.813573 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.813661 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.813844 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.813940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.814157 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.814258 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.814465 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.814560 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.814775 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.814876 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.815082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.815228 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.815430 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.815558 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.815795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.816117 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.816434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.816808 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.816935 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.817043 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.817132 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.817333 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.817445 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.817669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.817775 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.818004 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.818107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.818331 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.818427 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.818645 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.818741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.818968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.819062 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.819284 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.819380 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.819625 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.819739 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.819942 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.820048 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.820257 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.820359 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.820567 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.820711 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.820881 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.821018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.821194 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.821302 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.821512 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.821757 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.821853 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.822096 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.822200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.822419 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.822522 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.822740 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.822889 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.823094 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.823241 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.823375 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.823465 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.823717 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.823814 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.824038 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.824134 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.824359 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.824457 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.824677 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.824771 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.824995 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.825100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.825333 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.825438 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.825655 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.825748 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.825978 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.826073 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.826301 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.826397 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.826614 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.826718 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.826936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.827036 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.827254 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.827348 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.828143 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.828265 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.828457 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.828681 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.829052 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.829266 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.829422 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.829604 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.829746 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.829931 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.830067 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.830257 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.830397 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.830581 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.830729 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.830902 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.831064 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.831220 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.831376 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.831561 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.831721 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.831886 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.832042 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.832203 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.832381 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.832520 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.832665 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.832840 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.832989 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.833205 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.833362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.833497 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.833588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.833815 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.833922 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.834145 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.834242 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.834467 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.834570 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.834788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.834892 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.835111 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.835214 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.835438 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.835665 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.835801 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.835987 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.836137 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.836327 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.836458 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.836659 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.836764 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.836991 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.837095 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.837316 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.837419 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.837639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.837735 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.837978 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.838076 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.838326 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.838420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.838683 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.838821 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.839208 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.839339 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.839462 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.839701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.839831 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.839955 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.840081 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.840196 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.840308 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.840420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.840563 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.840714 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.840883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.841003 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.841194 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.841314 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.841619 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.841749 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.841941 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.842063 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.842263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.842386 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.842580 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.842717 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.842893 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.843038 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.843323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.843474 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.843631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.843844 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.844105 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.844420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.844732 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.845056 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.845374 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.845685 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.845993 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.846314 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.846629 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.846937 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.847253 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.847595 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.847933 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.848068 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.848250 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.848520 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.848666 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.848855 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.849026 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.849162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.849470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.849612 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.849780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.849980 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.850124 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.850383 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.850517 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.850701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.851012 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.851146 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.851426 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.851575 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.851763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.851965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.852110 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.852429 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.852570 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.852746 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.853024 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.853170 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.853443 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.853678 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.853991 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.854139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.854316 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.854574 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.854712 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.854946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.855178 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.855313 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.855659 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.855848 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.856015 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.856293 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.856436 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.856741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.856891 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.857188 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.857332 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.857518 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.857699 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.857857 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.858169 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.858305 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.858498 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.858733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.858885 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.859130 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.859276 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.859457 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.859644 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.859782 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.860098 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.860250 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.860409 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.860615 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.860752 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.861024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.861168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.861337 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.861543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.861679 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.861950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.862141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.862278 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.862563 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.862704 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.862877 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.863082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.863219 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.863638 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.863830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.863993 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.864191 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.864480 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.864614 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.864806 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.865130 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.865264 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.865452 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.865628 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.865763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.866075 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.866208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.866388 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.866611 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.866754 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.866999 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.867141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.867322 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.867556 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.867695 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.867985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.868204 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.868339 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.868472 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.868718 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.868897 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.869040 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.869336 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.869471 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.869658 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.869799 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.869975 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.870232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.870380 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.870613 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.870755 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.870930 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.871156 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.871305 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.871583 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.871721 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.871919 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.872104 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.872263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.872553 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.872690 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.872912 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.873053 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.873222 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.873526 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.873697 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.873905 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.874132 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.875002 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.875245 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.875391 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.875635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.875781 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.875942 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.876254 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.876394 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.876563 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.876757 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.876894 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.877166 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.877307 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.877475 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.877696 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.877841 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.878077 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.878209 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.878383 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.878620 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.878766 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.878989 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.879123 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.879294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.879585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.879738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.879925 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.880061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.880231 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.880516 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.880659 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.880829 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.881137 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.881278 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.881440 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.881633 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.881768 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.882072 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.882210 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.882399 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.882565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.882708 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.883025 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.883171 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.883402 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.883587 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.883736 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.884059 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.884375 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.884519 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.884695 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.884908 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.885058 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.885335 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.885534 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.885672 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.885955 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.886151 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.886289 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.886575 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.886718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.886891 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.887065 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.887200 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.887495 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.887682 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.887871 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.888007 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.888182 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.888414 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.888558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.888828 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.889053 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.889188 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.889458 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.889601 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.889777 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.890505 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.890670 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.890947 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.891091 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.891292 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.891627 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.891786 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.891969 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.892103 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.892287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.892529 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.892679 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.892910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.893051 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.893227 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.893469 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.893614 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.893852 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.894182 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.894377 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.894520 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.894812 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.894969 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.895176 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.895459 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.895628 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.895833 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.896009 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.896145 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.896483 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.896625 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.896815 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.897027 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.897163 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.897435 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.897580 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.897744 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.897990 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 12:21:17.898133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.898461 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.898854 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.899253 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.899673 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.900098 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.900493 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.901127 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.901530 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.901919 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.902307 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.902694 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.903093 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.903480 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.903928 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.904625 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.905033 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.905884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.906294 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.906778 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.907179 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.907621 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.908017 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.908409 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.908805 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.909194 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.909623 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.910027 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.910572 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.911006 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.911411 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.911821 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.912209 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.912597 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.912996 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.913382 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.913800 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.914498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.914894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.915285 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.915930 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.916347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.916834 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.917224 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.917613 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.918630 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.919263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.919686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.920103 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.920508 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.920912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.921340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.921753 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.922159 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.922545 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.922927 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.923323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.923734 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.924115 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.924842 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.925235 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.925616 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.926226 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.926723 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.927350 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.927826 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.928220 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.928620 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.929023 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.929413 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.929796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.930194 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.930576 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.930957 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.931345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.931756 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.932136 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.932515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.932915 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.933303 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.933680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.934064 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.934768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.935176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.935584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.936181 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.936565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.937570 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.937954 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.938336 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.938717 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.939111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.939499 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.939902 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.940392 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.940773 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.941162 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.941589 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.941973 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.942353 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.942752 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.943132 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.943539 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.943943 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.944328 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.945276 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.945675 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.946262 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.946698 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.947097 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.947863 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.948279 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.948679 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.949091 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.949501 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.949883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.950275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.950659 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.951058 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.951445 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.951862 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.952248 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.953203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.953603 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.953987 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.954503 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.955262 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.955679 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.956071 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.956687 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.957081 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.957575 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.957968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.958360 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.958779 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.959179 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.959597 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.959947 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO dbcounter [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] Registered counter for database nova_api Oct 06 12:21:17.960105 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.960417 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.960802 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.961197 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.961579 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.961960 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.962351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.962796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.963180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.963591 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.964097 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.964488 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.965148 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.965643 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.966033 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.966431 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.967044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.967438 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.967933 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.968844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.969249 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.969670 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.970075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.970475 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.970855 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.971234 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.971639 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.972025 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.972430 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.972815 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.973194 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.973581 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.973962 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.974336 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.974713 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.976515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.979397 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.979844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.980176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.980516 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.980860 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.981000 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_db.sqlalchemy.engines [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:21:17.981225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.981523 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.981852 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.982323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.982528 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.982822 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.983141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.983464 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.984378 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.984732 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.985133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.985479 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.985824 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.986146 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.986481 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.986807 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.987141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.987474 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.987849 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.988176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.988521 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.988846 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.989168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.989597 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.989706 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writer thread running {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:21:17.989971 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.990249 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.990629 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.990915 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.991255 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.991609 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.991945 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.992276 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.992607 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.992935 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.993257 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.993598 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.993917 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.994236 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.994558 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.994879 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.995196 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.995525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.995866 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.996185 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.996505 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.996833 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.997156 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.997495 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.997815 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.998155 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.998485 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.998845 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.999169 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:17.999685 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:18.000028 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:18.000353 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:18.000675 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:18.000995 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:21:18.001243 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 12:21:18.048739 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.context [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb99d91a-faea-4edc-b2f3-5f1d1dc1315d(cell1) {{(pid=120509) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 12:21:18.052818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:21:18.053298 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:21:18.054863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:21:18.055646 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:21:18.056095 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:21:18.058108 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:21:18.060129 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO dbcounter [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] Registered counter for database nova_cell0 Oct 06 12:21:18.063403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO dbcounter [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] Registered counter for database nova_api Oct 06 12:21:18.064316 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO dbcounter [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] Registered counter for database nova_cell1 Oct 06 12:21:18.071640 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_db.sqlalchemy.engines [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:21:18.074156 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_db.sqlalchemy.engines [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:21:18.083646 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writer thread running {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:21:18.083992 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writer thread running {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:21:18.085012 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_db.sqlalchemy.engines [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:21:18.091633 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writer thread running {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:21:18.147686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.context [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb99d91a-faea-4edc-b2f3-5f1d1dc1315d(cell1) {{(pid=120508) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 12:21:18.151614 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:21:18.152094 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:21:18.153659 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:21:18.154405 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:21:18.154867 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:21:18.157731 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:21:18.159741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO dbcounter [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] Registered counter for database nova_cell0 Oct 06 12:21:18.163764 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO dbcounter [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] Registered counter for database nova_cell1 Oct 06 12:21:18.170948 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_db.sqlalchemy.engines [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:21:18.173436 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_db.sqlalchemy.engines [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:21:18.180365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writer thread running {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:21:18.182471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writer thread running {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:21:18.231704 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO dbcounter [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] Registered counter for database nova_cell0 Oct 06 12:21:18.238358 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_db.sqlalchemy.engines [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:21:18.246374 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writer thread running {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:21:18.332639 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO dbcounter [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] Registered counter for database nova_cell0 Oct 06 12:21:18.339251 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_db.sqlalchemy.engines [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:21:18.344496 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writer thread running {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:21:18.566273 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: WARNING keystonemiddleware.auth_token [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:21:18.573556 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: WARNING keystonemiddleware.auth_token [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:21:18.662484 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: WARNING keystonemiddleware.auth_token [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:21:18.669838 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: WARNING keystonemiddleware.auth_token [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:21:18.923452 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: WARNING keystonemiddleware.auth_token [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:21:18.930281 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: WARNING keystonemiddleware.auth_token [None req-aeba960d-1791-40ee-a7c2-ed504bd49646 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:21:18.935694 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d59c03c9c0 pid: 120509 (default app) Oct 06 12:21:19.013455 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: WARNING keystonemiddleware.auth_token [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:21:19.019549 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: WARNING keystonemiddleware.auth_token [None req-b27c969e-5e62-4ab9-b502-175cda7c915d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:21:19.024871 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d59c03c9c0 pid: 120508 (default app) Oct 06 12:22:10.225618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=3 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:10.226610 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=3 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:10.227425 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=3 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:10.228572 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=3 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:10.591653 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=3 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:10.592448 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=3 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:10.595083 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=3 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:10.597793 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=3 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:12.179787 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9cb33eae-7b0c-4372-b78d-c66a9a31ffe3 tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] Action: 'create', calling method: .version_select at 0x7f03abb274c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-654412487", "metadata": {"Type": "work"}}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:22:12.328749 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6343ec95-505c-4bb4-9328-b422d657c311 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Action: 'create', calling method: .version_select at 0x7f03abb264c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-249172983", "metadata": {"Type": "work"}}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6343ec95-505c-4bb4-9328-b422d657c311 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Request method failure captured: Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 121 Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPshyAid9HgbL4eL09AEJ-F70iERy59r-s4gO58TMoT8rRQl9RlHk5upp790nNoOCoa0G4J0_6zovKjYULsFTfF36TKcirCtv6NoSJxbTdbtaO2aPP9ZA98PO6g3JoUQdkrv0YX6tUjajEX1nPNte0HiAPzxRdHWTmoqGmivuzKsGNps Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: 33120f340d8f452597ace0cdcba72b8c Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:22:12.335494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:22:12.336994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_33120f340d8f452597ace0cdcba72b8c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:22:12.336994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:12.336994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: 33120f340d8f452597ace0cdcba72b8c Oct 06 12:22:12.336994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:12.336994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-VolumesNegativeTest-562053271-project Oct 06 12:22:12.336994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:22:12.336994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:22:12.336994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 6c9e75ec32704fd9897e489d633432bf Oct 06 12:22:12.336994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-VolumesNegativeTest-562053271-project Oct 06 12:22:12.336994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Oct 06 12:22:12.336994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-249172983", "metadata": {"Type": "work"}}} Oct 06 12:22:12.336994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: Oct 06 12:22:12.336994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-249172983', 'metadata': {'Type': 'work'}}}} Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi '#$%' Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:22:12.337895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:22:12.340351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:22:12.343743 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 06 12:22:12.343743 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.343743 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6343ec95-505c-4bb4-9328-b422d657c311 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:22:12.343743 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-6343ec95-505c-4bb4-9328-b422d657c311 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.756718 Oct 06 12:22:12.343743 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Oct 6 12:22:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1759 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 06 12:22:12.351654 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4796ed5e-e2b8-4dbb-9773-c66cf5609b70 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Action: 'create', calling method: .version_select at 0x7f03abb26dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1608552540", "metadata": {"Type": "work"}}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4796ed5e-e2b8-4dbb-9773-c66cf5609b70 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Request method failure captured: Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 120 Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPshyAid9HgbL4eL09AEJ-F70iERy59r-s4gO58TMoT8rRQl9RlHk5upp790nNoOCoa0G4J0_6zovKjYULsFTfF36TKcirCtv6NoSJxbTdbtaO2aPP9ZA98PO6g3JoUQdkrv0YX6tUjajEX1nPNte0HiAPzxRdHWTmoqGmivuzKsGNps Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: 33120f340d8f452597ace0cdcba72b8c Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:22:12.355401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:22:12.356733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_33120f340d8f452597ace0cdcba72b8c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:22:12.356733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:12.356733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: 33120f340d8f452597ace0cdcba72b8c Oct 06 12:22:12.356733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:12.356733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-VolumesNegativeTest-562053271-project Oct 06 12:22:12.356733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:22:12.356733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:22:12.356733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 6c9e75ec32704fd9897e489d633432bf Oct 06 12:22:12.356733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-VolumesNegativeTest-562053271-project Oct 06 12:22:12.356733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Oct 06 12:22:12.356733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1608552540", "metadata": {"Type": "work"}}} Oct 06 12:22:12.356733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: Oct 06 12:22:12.356733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1608552540', 'metadata': {'Type': 'work'}}}} Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi '0' Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:22:12.357584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:22:12.358940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:22:12.360177 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 06 12:22:12.360177 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.360177 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4796ed5e-e2b8-4dbb-9773-c66cf5609b70 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:22:12.360177 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4796ed5e-e2b8-4dbb-9773-c66cf5609b70 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011100 Oct 06 12:22:12.360177 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 2/2] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Oct 6 12:22:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:22:12.369019 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-069a2dc7-019e-4668-8a62-4cdb80f74438 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Action: 'create', calling method: .version_select at 0x7f03ab9e1280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1845476801", "metadata": {"Type": "work"}}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-069a2dc7-019e-4668-8a62-4cdb80f74438 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Request method failure captured: Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 119 Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPshyAid9HgbL4eL09AEJ-F70iERy59r-s4gO58TMoT8rRQl9RlHk5upp790nNoOCoa0G4J0_6zovKjYULsFTfF36TKcirCtv6NoSJxbTdbtaO2aPP9ZA98PO6g3JoUQdkrv0YX6tUjajEX1nPNte0HiAPzxRdHWTmoqGmivuzKsGNps Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: 33120f340d8f452597ace0cdcba72b8c Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:22:12.373217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:22:12.374599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_33120f340d8f452597ace0cdcba72b8c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:22:12.374599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:12.374599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: 33120f340d8f452597ace0cdcba72b8c Oct 06 12:22:12.374599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:12.374599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-VolumesNegativeTest-562053271-project Oct 06 12:22:12.374599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:22:12.374599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:22:12.374599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 6c9e75ec32704fd9897e489d633432bf Oct 06 12:22:12.374599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-VolumesNegativeTest-562053271-project Oct 06 12:22:12.374599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Oct 06 12:22:12.374599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1845476801", "metadata": {"Type": "work"}}} Oct 06 12:22:12.374599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: Oct 06 12:22:12.374599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1845476801', 'metadata': {'Type': 'work'}}}} Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi '' Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:22:12.376498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:22:12.377844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:22:12.379135 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 06 12:22:12.379135 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:12.379135 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-069a2dc7-019e-4668-8a62-4cdb80f74438 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:22:12.379135 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-069a2dc7-019e-4668-8a62-4cdb80f74438 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010141 Oct 06 12:22:12.379135 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 3/3] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Oct 6 12:22:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:22:12.391950 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9eca23bd-1014-4abc-8d5f-c4635421db43 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Calling method '.version_select at 0x7f03ab9e1d30>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:13.178217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-9eca23bd-1014-4abc-8d5f-c4635421db43 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] HTTP exception thrown: Volume tempest-invalid-2069380671 could not be found. Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9eca23bd-1014-4abc-8d5f-c4635421db43 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Request method failure captured: Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2069380671 HTTP/1.1 Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPshyAid9HgbL4eL09AEJ-F70iERy59r-s4gO58TMoT8rRQl9RlHk5upp790nNoOCoa0G4J0_6zovKjYULsFTfF36TKcirCtv6NoSJxbTdbtaO2aPP9ZA98PO6g3JoUQdkrv0YX6tUjajEX1nPNte0HiAPzxRdHWTmoqGmivuzKsGNps Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: 33120f340d8f452597ace0cdcba72b8c Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:22:13.182362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:22:13.221203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_33120f340d8f452597ace0cdcba72b8c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:22:13.221203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:13.221203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: 33120f340d8f452597ace0cdcba72b8c Oct 06 12:22:13.221203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:13.221203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-VolumesNegativeTest-562053271-project Oct 06 12:22:13.221203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:22:13.221203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:22:13.221203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 6c9e75ec32704fd9897e489d633432bf Oct 06 12:22:13.221203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-VolumesNegativeTest-562053271-project Oct 06 12:22:13.221203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: Oct 06 12:22:13.221203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Volume tempest-invalid-2069380671 could not be found. Oct 06 12:22:13.221203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': 'tempest-invalid-2069380671'} Oct 06 12:22:13.221203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2069380671 could not be found. (HTTP 404) (Request-ID: req-9fa0a53b-c451-421e-b2b5-c2bd51b1377e) Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:13.223990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 12:22:13.228471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2069380671 could not be found. Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:22:13.233631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2069380671 could not be found. Oct 06 12:22:13.237588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.237588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:13.237588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.237588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:13.237588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:22:13.237588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:22:13.237588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:22:13.237588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:22:13.237588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2069380671 could not be found. Oct 06 12:22:13.237588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.237588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9eca23bd-1014-4abc-8d5f-c4635421db43 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Returning 404 to user: Volume tempest-invalid-2069380671 could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:22:13.237588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9eca23bd-1014-4abc-8d5f-c4635421db43 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2069380671" status: 404 len: 99 microversion: 2.1 time: 0.802556 Oct 06 12:22:13.237588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 4/4] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Oct 6 12:22:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2069380671 => generated 99 bytes in 805 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:22:13.240524 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-39c97390-e6fb-4e1c-a48c-1c0c35f9486e tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010363 Oct 06 12:22:13.240524 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 5/5] 10.222.0.33 () {58 vars in 1140 bytes} [Thu Oct 6 12:22:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 06 12:22:13.240524 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f6a03e02-6306-4acb-9e06-92cd24fb021d tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005901 Oct 06 12:22:13.240524 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 6/6] 10.222.0.33 () {58 vars in 1137 bytes} [Thu Oct 6 12:22:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 06 12:22:13.240524 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5a664e74-4792-4b63-95c0-fee7f52512e5 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Calling method '.version_select at 0x7f03ab918430>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:13.541109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-5a664e74-4792-4b63-95c0-fee7f52512e5 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] HTTP exception thrown: Volume 9e1e35c7-9141-4995-9f15-d108386f4501 could not be found. Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5a664e74-4792-4b63-95c0-fee7f52512e5 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Request method failure captured: Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: DELETE /compute/v2.1/os-volumes/9e1e35c7-9141-4995-9f15-d108386f4501 HTTP/1.1 Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPshyAid9HgbL4eL09AEJ-F70iERy59r-s4gO58TMoT8rRQl9RlHk5upp790nNoOCoa0G4J0_6zovKjYULsFTfF36TKcirCtv6NoSJxbTdbtaO2aPP9ZA98PO6g3JoUQdkrv0YX6tUjajEX1nPNte0HiAPzxRdHWTmoqGmivuzKsGNps Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: 33120f340d8f452597ace0cdcba72b8c Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:22:13.544034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:22:13.545912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_33120f340d8f452597ace0cdcba72b8c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:22:13.545912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:13.545912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: 33120f340d8f452597ace0cdcba72b8c Oct 06 12:22:13.545912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:13.545912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-VolumesNegativeTest-562053271-project Oct 06 12:22:13.545912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:22:13.545912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:22:13.545912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 6c9e75ec32704fd9897e489d633432bf Oct 06 12:22:13.545912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-VolumesNegativeTest-562053271-project Oct 06 12:22:13.545912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: Oct 06 12:22:13.545912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Volume 9e1e35c7-9141-4995-9f15-d108386f4501 could not be found. Oct 06 12:22:13.545912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '9e1e35c7-9141-4995-9f15-d108386f4501'} Oct 06 12:22:13.545912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e1e35c7-9141-4995-9f15-d108386f4501 could not be found. (HTTP 404) (Request-ID: req-c89c0090-87b4-42b9-a339-c0a5aeec15c7) Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:13.546669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 12:22:13.547767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e1e35c7-9141-4995-9f15-d108386f4501 could not be found. Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 06 12:22:13.549347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:22:13.550418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9e1e35c7-9141-4995-9f15-d108386f4501 could not be found. Oct 06 12:22:13.550418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.550418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:13.550418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.550418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:13.550418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:22:13.550418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:22:13.550418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:22:13.550418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:22:13.550418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e1e35c7-9141-4995-9f15-d108386f4501 could not be found. Oct 06 12:22:13.550418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.553012 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5a664e74-4792-4b63-95c0-fee7f52512e5 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Returning 404 to user: Volume 9e1e35c7-9141-4995-9f15-d108386f4501 could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:22:13.554690 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5a664e74-4792-4b63-95c0-fee7f52512e5 tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/9e1e35c7-9141-4995-9f15-d108386f4501" status: 404 len: 109 microversion: 2.1 time: 0.322877 Oct 06 12:22:13.555424 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 7/7] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 12:22:13 2022] DELETE /compute/v2.1/os-volumes/9e1e35c7-9141-4995-9f15-d108386f4501 => generated 109 bytes in 325 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:22:13.571216 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a8c3e887-b644-4559-96f2-8e5400d10e4f tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Calling method '.version_select at 0x7f03ab9181f0>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:13.836388 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-a8c3e887-b644-4559-96f2-8e5400d10e4f tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] HTTP exception thrown: Volume 48202fb8-c4bb-4d81-aa9f-0b5c3419e976 could not be found. Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a8c3e887-b644-4559-96f2-8e5400d10e4f tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Request method failure captured: Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: GET /compute/v2.1/os-volumes/48202fb8-c4bb-4d81-aa9f-0b5c3419e976 HTTP/1.1 Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPshyAid9HgbL4eL09AEJ-F70iERy59r-s4gO58TMoT8rRQl9RlHk5upp790nNoOCoa0G4J0_6zovKjYULsFTfF36TKcirCtv6NoSJxbTdbtaO2aPP9ZA98PO6g3JoUQdkrv0YX6tUjajEX1nPNte0HiAPzxRdHWTmoqGmivuzKsGNps Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: 33120f340d8f452597ace0cdcba72b8c Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:22:13.838434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:22:13.839590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_33120f340d8f452597ace0cdcba72b8c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/33120f340d8f452597ace0cdcba72b8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:22:13.839590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:13.839590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: 33120f340d8f452597ace0cdcba72b8c Oct 06 12:22:13.839590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-VolumesNegativeTest-562053271 Oct 06 12:22:13.839590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-VolumesNegativeTest-562053271-project Oct 06 12:22:13.839590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:22:13.839590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:22:13.839590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 6c9e75ec32704fd9897e489d633432bf Oct 06 12:22:13.839590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-VolumesNegativeTest-562053271-project Oct 06 12:22:13.839590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: Oct 06 12:22:13.839590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Volume 48202fb8-c4bb-4d81-aa9f-0b5c3419e976 could not be found. Oct 06 12:22:13.839590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '48202fb8-c4bb-4d81-aa9f-0b5c3419e976'} Oct 06 12:22:13.839590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 48202fb8-c4bb-4d81-aa9f-0b5c3419e976 could not be found. (HTTP 404) (Request-ID: req-a378aabf-00d5-45fc-9204-07a034c25f7a) Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:13.840345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 12:22:13.842079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 48202fb8-c4bb-4d81-aa9f-0b5c3419e976 could not be found. Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 12:22:13.843082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:22:13.844200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 48202fb8-c4bb-4d81-aa9f-0b5c3419e976 could not be found. Oct 06 12:22:13.844200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.844200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:13.844200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.844200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:13.844200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:22:13.844200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:22:13.844200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:22:13.844200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:22:13.844200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 48202fb8-c4bb-4d81-aa9f-0b5c3419e976 could not be found. Oct 06 12:22:13.844200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:22:13.857480 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a8c3e887-b644-4559-96f2-8e5400d10e4f tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] Returning 404 to user: Volume 48202fb8-c4bb-4d81-aa9f-0b5c3419e976 could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:22:13.858499 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a8c3e887-b644-4559-96f2-8e5400d10e4f tempest-VolumesNegativeTest-562053271 tempest-VolumesNegativeTest-562053271-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/48202fb8-c4bb-4d81-aa9f-0b5c3419e976" status: 404 len: 109 microversion: 2.1 time: 0.297314 Oct 06 12:22:13.861362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 8/8] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 12:22:13 2022] GET /compute/v2.1/os-volumes/48202fb8-c4bb-4d81-aa9f-0b5c3419e976 => generated 109 bytes in 301 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:22:13.963337 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9cb33eae-7b0c-4372-b78d-c66a9a31ffe3 tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.749348 Oct 06 12:22:13.964368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 1/9] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Oct 6 12:22:10 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3753 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 06 12:22:13.990049 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9c9d5203-853d-421e-a06e-1fb95ee5f60f tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] Calling method '.version_select at 0x7f03ab9e3040>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:14.096767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9c9d5203-853d-421e-a06e-1fb95ee5f60f tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/304aaac9-d253-4973-88ac-3552c733de78" status: 200 len: 352 microversion: 2.1 time: 0.114587 Oct 06 12:22:14.097802 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 9/10] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 12:22:13 2022] GET /compute/v2.1/os-volumes/304aaac9-d253-4973-88ac-3552c733de78 => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:22:14.413535 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-03d17076-1eae-4e59-95ec-f8c91546b8a0 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] Calling method '.version_select at 0x7f03ab9f83a0>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:14.524861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-03d17076-1eae-4e59-95ec-f8c91546b8a0 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/69d85527-e8ad-400b-8c34-aecdd9df91a8" status: 200 len: 351 microversion: 2.1 time: 0.117494 Oct 06 12:22:14.525419 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 2/11] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 12:22:14 2022] GET /compute/v2.1/os-volumes/69d85527-e8ad-400b-8c34-aecdd9df91a8 => generated 351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:22:15.111944 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2eeb6618-9979-4590-b6bc-158b93051fee tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] Calling method '.version_select at 0x7f03ab918790>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:15.409756 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2eeb6618-9979-4590-b6bc-158b93051fee tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/304aaac9-d253-4973-88ac-3552c733de78" status: 200 len: 353 microversion: 2.1 time: 0.301605 Oct 06 12:22:15.411032 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 10/12] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 12:22:15 2022] GET /compute/v2.1/os-volumes/304aaac9-d253-4973-88ac-3552c733de78 => generated 353 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:22:15.424593 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-01cfe99d-1384-448b-95b7-163b08605b79 tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] Calling method '.version_select at 0x7f03ab9f8af0>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:15.528538 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-01cfe99d-1384-448b-95b7-163b08605b79 tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/304aaac9-d253-4973-88ac-3552c733de78" status: 200 len: 353 microversion: 2.1 time: 0.107783 Oct 06 12:22:15.530202 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 3/13] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 12:22:15 2022] GET /compute/v2.1/os-volumes/304aaac9-d253-4973-88ac-3552c733de78 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:22:15.550136 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a3b3224c-d2d1-4395-9e0c-931d5bd91266 tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] Calling method '.version_select at 0x7f03ab918160>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:15.653639 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a3b3224c-d2d1-4395-9e0c-931d5bd91266 tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/304aaac9-d253-4973-88ac-3552c733de78" status: 202 len: 0 microversion: 2.1 time: 0.107509 Oct 06 12:22:15.654323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 11/14] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 12:22:15 2022] DELETE /compute/v2.1/os-volumes/304aaac9-d253-4973-88ac-3552c733de78 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:22:15.665365 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e668b8b7-3f7b-44a3-b47f-f019d3da9fe3 tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] Calling method '.version_select at 0x7f03ab9941f0>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:15.775015 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e668b8b7-3f7b-44a3-b47f-f019d3da9fe3 tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/304aaac9-d253-4973-88ac-3552c733de78" status: 200 len: 352 microversion: 2.1 time: 0.114560 Oct 06 12:22:15.779008 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 4/15] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 12:22:15 2022] GET /compute/v2.1/os-volumes/304aaac9-d253-4973-88ac-3552c733de78 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:22:16.407579 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-749b1adc-87aa-4778-a081-81ee108fd548 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] Calling method '.version_select at 0x7f03ab91c040>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:16.537988 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-749b1adc-87aa-4778-a081-81ee108fd548 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/6d56171a-61a6-4304-9d1c-ea8e76eeed7f" status: 200 len: 350 microversion: 2.1 time: 0.135360 Oct 06 12:22:16.538840 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 12/16] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 12:22:16 2022] GET /compute/v2.1/os-volumes/6d56171a-61a6-4304-9d1c-ea8e76eeed7f => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:22:16.794942 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e8cff229-650d-4076-8eb6-7e65541159f8 tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] Calling method '.version_select at 0x7f03ab9f8d30>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:16.965903 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-e8cff229-650d-4076-8eb6-7e65541159f8 tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] HTTP exception thrown: Volume 304aaac9-d253-4973-88ac-3552c733de78 could not be found. Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e8cff229-650d-4076-8eb6-7e65541159f8 tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] Request method failure captured: Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/os-volumes/304aaac9-d253-4973-88ac-3552c733de78 HTTP/1.1 Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPshyvSzIPwJgVja-IcCRVxVGQwKq-44K16_SXi3ZJ0Hj_X_1AvUU58T6QirUurIHB4On3IHFsvTVNIhdePhhkC4Q9BOleursr5GmcAvDbJU738nvPobcGh8jGQqqROoflCptHu-2igogHQw3GtaySZPUwJ4r70RLmhUHxwjWO93ysY8 Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: a214702b5d894605a09e9321e280a5b1 Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-VolumesGetTestJSON-695020491 Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:22:16.971780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:22:16.973047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a214702b5d894605a09e9321e280a5b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a214702b5d894605a09e9321e280a5b1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a214702b5d894605a09e9321e280a5b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a214702b5d894605a09e9321e280a5b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:22:16.973047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-VolumesGetTestJSON-695020491 Oct 06 12:22:16.973047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: a214702b5d894605a09e9321e280a5b1 Oct 06 12:22:16.973047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-VolumesGetTestJSON-695020491 Oct 06 12:22:16.973047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-VolumesGetTestJSON-695020491-project Oct 06 12:22:16.973047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:22:16.973047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:22:16.973047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 11c3485cad2f45fda12277f74801c841 Oct 06 12:22:16.973047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-VolumesGetTestJSON-695020491-project Oct 06 12:22:16.973047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: Oct 06 12:22:16.973047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Volume 304aaac9-d253-4973-88ac-3552c733de78 could not be found. Oct 06 12:22:16.973047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '304aaac9-d253-4973-88ac-3552c733de78'} Oct 06 12:22:16.973047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 304aaac9-d253-4973-88ac-3552c733de78 could not be found. (HTTP 404) (Request-ID: req-87d6bacd-257c-4062-bae1-546013ca9106) Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:16.973756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 12:22:16.974700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 304aaac9-d253-4973-88ac-3552c733de78 could not be found. Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 12:22:16.975635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:22:16.976562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 304aaac9-d253-4973-88ac-3552c733de78 could not be found. Oct 06 12:22:16.976562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:22:16.976562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:22:16.976562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:22:16.976562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:22:16.976562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:22:16.976562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:22:16.976562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:22:16.976562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:22:16.976562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 304aaac9-d253-4973-88ac-3552c733de78 could not be found. Oct 06 12:22:16.976562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:22:16.976562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e8cff229-650d-4076-8eb6-7e65541159f8 tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] Returning 404 to user: Volume 304aaac9-d253-4973-88ac-3552c733de78 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:22:16.976562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e8cff229-650d-4076-8eb6-7e65541159f8 tempest-VolumesGetTestJSON-695020491 tempest-VolumesGetTestJSON-695020491-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/304aaac9-d253-4973-88ac-3552c733de78" status: 404 len: 109 microversion: 2.1 time: 0.184644 Oct 06 12:22:16.976562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 5/17] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 12:22:16 2022] GET /compute/v2.1/os-volumes/304aaac9-d253-4973-88ac-3552c733de78 => generated 109 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:22:18.332821 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7e4ed881-63f3-46dc-addf-4fbedfd2cc19 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] Calling method '.version_select at 0x7f03ab918550>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:18.482807 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7e4ed881-63f3-46dc-addf-4fbedfd2cc19 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/9790d5bb-b5a1-4654-98a1-62c5403e472c" status: 200 len: 351 microversion: 2.1 time: 0.153411 Oct 06 12:22:18.483888 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 13/18] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 12:22:18 2022] GET /compute/v2.1/os-volumes/9790d5bb-b5a1-4654-98a1-62c5403e472c => generated 351 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:22:18.501496 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b6ace8b0-abbb-4314-94fd-03273247ebfc tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] Calling method '.version_select at 0x7f03ac353b80>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:18.781323 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b6ace8b0-abbb-4314-94fd-03273247ebfc tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.287948 Oct 06 12:22:18.782416 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 6/19] 10.222.0.33 () {58 vars in 1134 bytes} [Thu Oct 6 12:22:18 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:18.801427 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-fae18e88-53f0-4611-a459-d0ab32b80fa6 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] Calling method '.version_select at 0x7f03ab966ca0>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:19.000068 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-fae18e88-53f0-4611-a459-d0ab32b80fa6 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.206033 Oct 06 12:22:19.001124 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 14/20] 10.222.0.33 () {58 vars in 1149 bytes} [Thu Oct 6 12:22:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:22:19.015463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5c93dae7-34c9-4534-bd6f-9c6e7a8ef591 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] Calling method '.version_select at 0x7f03ab993700>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:19.248337 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5c93dae7-34c9-4534-bd6f-9c6e7a8ef591 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.236430 Oct 06 12:22:19.257415 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 7/21] 10.222.0.33 () {58 vars in 1134 bytes} [Thu Oct 6 12:22:19 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:19.262429 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-70661797-1a2e-4f0c-9f58-4b88cf40ae32 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] Calling method '.version_select at 0x7f03ab91c0d0>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:19.536850 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-70661797-1a2e-4f0c-9f58-4b88cf40ae32 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.278594 Oct 06 12:22:19.537739 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 15/22] 10.222.0.33 () {58 vars in 1167 bytes} [Thu Oct 6 12:22:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:22:19.553987 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b8bebf6f-cd23-4eb2-8024-70fd5f80ce98 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] Calling method '.version_select at 0x7f03ab98ca60>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:19.870039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b8bebf6f-cd23-4eb2-8024-70fd5f80ce98 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.320227 Oct 06 12:22:19.887338 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 8/23] 10.222.0.33 () {58 vars in 1170 bytes} [Thu Oct 6 12:22:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:22:19.889775 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0a4b9288-0a2f-4cf4-bc92-d31be76cd6ad tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] Calling method '.version_select at 0x7f03ab91c820>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:19.999447 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-0a4b9288-0a2f-4cf4-bc92-d31be76cd6ad tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.115858 Oct 06 12:22:20.014928 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e1ed19aa-63aa-44ea-b7c2-9f663cf9b211 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] Calling method '.version_select at 0x7f03ab98c790>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:20.015644 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 16/24] 10.222.0.33 () {58 vars in 1155 bytes} [Thu Oct 6 12:22:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:20.144153 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e1ed19aa-63aa-44ea-b7c2-9f663cf9b211 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.133177 Oct 06 12:22:20.144925 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 9/25] 10.222.0.33 () {58 vars in 1188 bytes} [Thu Oct 6 12:22:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:22:20.162695 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ee68e3e8-c983-41d0-b17e-895468983997 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] Calling method '.version_select at 0x7f03ab966c10>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:20.292462 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ee68e3e8-c983-41d0-b17e-895468983997 tempest-VolumesTestJSON-128119855 tempest-VolumesTestJSON-128119855-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.134848 Oct 06 12:22:20.309200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 17/26] 10.222.0.33 () {58 vars in 1155 bytes} [Thu Oct 6 12:22:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:23.297380 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-592991867", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:22:23.487392 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.network.neutron [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] validate_networks() for [('cca2176c-b240-4d92-a159-a5d2161a7a8d', None, None, None, None, None)] {{(pid=120509) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:22:23.704458 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7d1b4e7a-61cf-4e97-a2bc-4e0ec01a65cf tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Action: 'create', calling method: .version_select at 0x7f03ab922040>, body: {"keypair": {"name": "tempest-keypair-1871174398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3OXGmgIoQbGge9zlPXzrdfx9/XPcHc6M4f54B1xfCp9xVACyoQ4Wfn1J9xL3oUptXGFnbNL6MN1SIdWXpqepGOmhjsyckAW1eT4JNqux6/QNHBmGBxoWKyM13intLy/w=="}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:22:23.823349 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-7d1b4e7a-61cf-4e97-a2bc-4e0ec01a65cf tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Getting quotas for project 828d3459cdd641d98772383edfe3268f. Resources: {'key_pairs'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:22:23.845387 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-7d1b4e7a-61cf-4e97-a2bc-4e0ec01a65cf tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Getting quotas for user 3066c1c9c79942c289b733d886d9fd0f and project 828d3459cdd641d98772383edfe3268f. Resources: {'key_pairs'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:22:23.946526 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7d1b4e7a-61cf-4e97-a2bc-4e0ec01a65cf tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.760617 Oct 06 12:22:23.948369 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 18/27] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 12:22:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:22:26.497334 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Flavor limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:22:26.499156 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Image limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:22:26.499930 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Flavor pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:22:26.500551 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Image pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:22:26.501201 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:22:26.557686 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:26.559898 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:26.562375 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:26.563703 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:26.566981 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:26.568388 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:26.698861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Getting quotas for project 9138bc89f5204975a18156097530643a. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:22:26.735759 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Getting quotas for user 1f4cbe342b2c4378b3c0ab2f1cd55260 and project 9138bc89f5204975a18156097530643a. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:22:26.762683 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Going to run 1 instances... {{(pid=120509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:22:26.773913 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:22:26.974119 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ca1912a1-e498-4aa0-abcf-60da16e0a22f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.143741 Oct 06 12:22:26.981690 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 10/28] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:22:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 4152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:22:27.003443 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b2cc407a-943f-4e6c-9d7a-58ac11c3dcd4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:27.006626 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b2cc407a-943f-4e6c-9d7a-58ac11c3dcd4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:27.261573 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b2cc407a-943f-4e6c-9d7a-58ac11c3dcd4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:27.294981 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b2cc407a-943f-4e6c-9d7a-58ac11c3dcd4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1221 microversion: 2.1 time: 0.303906 Oct 06 12:22:27.298486 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 11/29] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:26 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1221 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:27.371166 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-224344817", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "networks": [{"uuid": "e55e0bb9-9e7d-4ab0-bc29-d2610e6959f2"}]}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:22:27.641568 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.network.neutron [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] validate_networks() for [('e55e0bb9-9e7d-4ab0-bc29-d2610e6959f2', None, None, None, None, None)] {{(pid=120508) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:22:28.172112 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1011654002", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:22:28.297742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.network.neutron [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] validate_networks() for [('cca2176c-b240-4d92-a159-a5d2161a7a8d', None, None, None, None, None)] {{(pid=120509) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:22:29.699370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Flavor limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:22:29.700630 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Image limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:22:29.701155 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Flavor pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:22:29.701759 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Image pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:22:29.702184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:22:29.735123 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:29.735678 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:29.738780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:29.739754 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:29.742263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:29.743579 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:29.789537 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Getting quotas for project 9138bc89f5204975a18156097530643a. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:22:29.800223 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Getting quotas for user 1f4cbe342b2c4378b3c0ab2f1cd55260 and project 9138bc89f5204975a18156097530643a. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:22:29.831812 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Going to run 1 instances... {{(pid=120509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:22:29.843008 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:22:29.914096 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Flavor limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:22:29.914788 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Image limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:22:29.915416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Flavor pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:22:29.916802 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Image pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:22:29.917240 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:22:29.944356 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b50aa403-2b53-4ebf-8bb6-d52864a0a0b1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.779665 Oct 06 12:22:29.948222 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 12/30] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:22:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 12:22:29.954150 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:29.954683 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:29.955134 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:29.955952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:29.959329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1827211178", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0805475d-8b9c-4baf-bd63-089b9f9df6f5"}], "security_groups": [{"name": "tempest-securitygroup--513175979"}], "key_name": "tempest-keypair-1871174398", "user_data": "}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:22:29.972289 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:29.972766 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:30.112804 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Getting quotas for project 69d2acb456bc4aaeae1ff0927195aba2. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:22:30.132148 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Getting quotas for user 18d196263d2c49f88b5f81acb2586bc1 and project 69d2acb456bc4aaeae1ff0927195aba2. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:22:30.184006 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Going to run 1 instances... {{(pid=120508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:22:30.190370 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:22:30.287946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.network.neutron [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] validate_networks() for [('0805475d-8b9c-4baf-bd63-089b9f9df6f5', None, None, None, None, None)] {{(pid=120509) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:22:30.334926 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f3fc641b-3c3b-42bd-ad55-525017eaf289 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.676285 Oct 06 12:22:30.335929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 19/31] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:22:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:22:30.341858 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c0aaf24b-dfd4-4718-875d-7498a342f821 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:30.342858 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c0aaf24b-dfd4-4718-875d-7498a342f821 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:30.635053 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c0aaf24b-dfd4-4718-875d-7498a342f821 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:30.672337 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c0aaf24b-dfd4-4718-875d-7498a342f821 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1222 microversion: 2.1 time: 0.334932 Oct 06 12:22:30.695847 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 20/32] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:30 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1222 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:30.707223 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c9a07ba2-8e62-423d-9466-5091e690c218 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:30.712691 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c9a07ba2-8e62-423d-9466-5091e690c218 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:30.867148 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c9a07ba2-8e62-423d-9466-5091e690c218 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:30.900802 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c9a07ba2-8e62-423d-9466-5091e690c218 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1214 microversion: 2.1 time: 0.200835 Oct 06 12:22:30.906061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 21/33] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:30 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:31.459588 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Flavor limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:22:31.460251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Image limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:22:31.461438 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Flavor pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:22:31.461922 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Image pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:22:31.462817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:22:31.485964 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:31.486940 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:31.490020 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:31.491430 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:31.494608 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:31.495636 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:31.520440 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Getting quotas for project 828d3459cdd641d98772383edfe3268f. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:22:31.533699 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Getting quotas for user 3066c1c9c79942c289b733d886d9fd0f and project 828d3459cdd641d98772383edfe3268f. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:22:31.552991 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Going to run 1 instances... {{(pid=120509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:22:31.556334 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:22:31.702602 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-59200bd2-3c78-4096-8cdf-8155702616a0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:31.703230 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-59200bd2-3c78-4096-8cdf-8155702616a0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:31.717698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-1a108638-50ce-4432-9515-21b894314207 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.760725 Oct 06 12:22:31.719234 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 13/34] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:22:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:22:31.742199 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-851109d0-3d08-4d26-9dee-03cfdf842451 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:31.747923 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-851109d0-3d08-4d26-9dee-03cfdf842451 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:31.848086 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-851109d0-3d08-4d26-9dee-03cfdf842451 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:31.864225 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-851109d0-3d08-4d26-9dee-03cfdf842451 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1238 microversion: 2.1 time: 0.136382 Oct 06 12:22:31.865125 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 14/35] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:31 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1238 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:31.889723 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-59200bd2-3c78-4096-8cdf-8155702616a0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:31.901271 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-59200bd2-3c78-4096-8cdf-8155702616a0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1222 microversion: 2.1 time: 0.202710 Oct 06 12:22:31.903717 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 22/36] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:31 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1222 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:22:31.930320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-49bb4065-9a4a-4202-af3b-05fd2089a697 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:31.931212 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-49bb4065-9a4a-4202-af3b-05fd2089a697 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:31.940353 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49bb4065-9a4a-4202-af3b-05fd2089a697 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:31.941322 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49bb4065-9a4a-4202-af3b-05fd2089a697 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:31.942199 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49bb4065-9a4a-4202-af3b-05fd2089a697 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:31.943281 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49bb4065-9a4a-4202-af3b-05fd2089a697 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:31.944677 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49bb4065-9a4a-4202-af3b-05fd2089a697 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:31.946283 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49bb4065-9a4a-4202-af3b-05fd2089a697 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:32.222589 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-49bb4065-9a4a-4202-af3b-05fd2089a697 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:32.242912 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-49bb4065-9a4a-4202-af3b-05fd2089a697 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1218 microversion: 2.1 time: 0.318254 Oct 06 12:22:32.243743 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 15/37] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:31 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1218 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:32.892887 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-22a994a1-2b87-40c9-8c55-3e08b07e8c00 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:32.894243 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-22a994a1-2b87-40c9-8c55-3e08b07e8c00 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:32.902599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22a994a1-2b87-40c9-8c55-3e08b07e8c00 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:32.905072 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22a994a1-2b87-40c9-8c55-3e08b07e8c00 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:32.906020 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22a994a1-2b87-40c9-8c55-3e08b07e8c00 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:32.907082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22a994a1-2b87-40c9-8c55-3e08b07e8c00 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:32.908098 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22a994a1-2b87-40c9-8c55-3e08b07e8c00 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:32.908675 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22a994a1-2b87-40c9-8c55-3e08b07e8c00 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:32.930427 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-cbe1feba-3659-4f00-96c6-62e775bcdebb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:32.931799 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-cbe1feba-3659-4f00-96c6-62e775bcdebb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:32.943843 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cbe1feba-3659-4f00-96c6-62e775bcdebb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:32.946203 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cbe1feba-3659-4f00-96c6-62e775bcdebb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:32.946917 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cbe1feba-3659-4f00-96c6-62e775bcdebb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:32.947904 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cbe1feba-3659-4f00-96c6-62e775bcdebb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:32.949624 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cbe1feba-3659-4f00-96c6-62e775bcdebb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:32.950600 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cbe1feba-3659-4f00-96c6-62e775bcdebb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:33.113298 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-cbe1feba-3659-4f00-96c6-62e775bcdebb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:33.124847 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-cbe1feba-3659-4f00-96c6-62e775bcdebb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1226 microversion: 2.1 time: 0.199748 Oct 06 12:22:33.127987 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 16/38] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:32 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1226 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:33.160566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-22a994a1-2b87-40c9-8c55-3e08b07e8c00 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:33.175537 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-22a994a1-2b87-40c9-8c55-3e08b07e8c00 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1242 microversion: 2.1 time: 0.286930 Oct 06 12:22:33.176631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 23/39] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:32 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1242 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:33.269989 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-db8e0733-9415-4179-9ebd-23db7d798eb6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:33.270712 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-db8e0733-9415-4179-9ebd-23db7d798eb6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:33.284569 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db8e0733-9415-4179-9ebd-23db7d798eb6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:33.285842 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db8e0733-9415-4179-9ebd-23db7d798eb6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:33.286514 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db8e0733-9415-4179-9ebd-23db7d798eb6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:33.287842 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db8e0733-9415-4179-9ebd-23db7d798eb6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:33.289924 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db8e0733-9415-4179-9ebd-23db7d798eb6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:33.291533 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db8e0733-9415-4179-9ebd-23db7d798eb6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:33.413337 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-db8e0733-9415-4179-9ebd-23db7d798eb6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:33.422985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-db8e0733-9415-4179-9ebd-23db7d798eb6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1210 microversion: 2.1 time: 0.158360 Oct 06 12:22:33.424026 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 17/40] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:33 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1210 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:34.156711 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-bdbdd62a-93f1-40af-86fb-b6b76628da8b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:34.157990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-bdbdd62a-93f1-40af-86fb-b6b76628da8b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:34.165011 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bdbdd62a-93f1-40af-86fb-b6b76628da8b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:34.165944 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bdbdd62a-93f1-40af-86fb-b6b76628da8b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:34.166546 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bdbdd62a-93f1-40af-86fb-b6b76628da8b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:34.167479 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bdbdd62a-93f1-40af-86fb-b6b76628da8b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:34.168180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bdbdd62a-93f1-40af-86fb-b6b76628da8b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:34.168889 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bdbdd62a-93f1-40af-86fb-b6b76628da8b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:34.204324 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ff1754b7-2ac7-4263-8518-9a8c9eac5bb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:34.204939 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ff1754b7-2ac7-4263-8518-9a8c9eac5bb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:34.214618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff1754b7-2ac7-4263-8518-9a8c9eac5bb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:34.217241 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff1754b7-2ac7-4263-8518-9a8c9eac5bb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:34.217709 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff1754b7-2ac7-4263-8518-9a8c9eac5bb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:34.221242 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff1754b7-2ac7-4263-8518-9a8c9eac5bb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:34.225892 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff1754b7-2ac7-4263-8518-9a8c9eac5bb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:34.227625 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff1754b7-2ac7-4263-8518-9a8c9eac5bb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:34.392977 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-bdbdd62a-93f1-40af-86fb-b6b76628da8b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:34.403940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-bdbdd62a-93f1-40af-86fb-b6b76628da8b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1218 microversion: 2.1 time: 0.250177 Oct 06 12:22:34.407069 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 24/41] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:34 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1218 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:34.435677 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ff1754b7-2ac7-4263-8518-9a8c9eac5bb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:34.451240 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0aafaabe-c2d6-4cf4-bbb4-b091ef46de1d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:34.451908 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-0aafaabe-c2d6-4cf4-bbb4-b091ef46de1d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:34.457242 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ff1754b7-2ac7-4263-8518-9a8c9eac5bb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1234 microversion: 2.1 time: 0.246100 Oct 06 12:22:34.459825 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 18/42] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:34 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1234 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:34.473548 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0aafaabe-c2d6-4cf4-bbb4-b091ef46de1d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:34.477914 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0aafaabe-c2d6-4cf4-bbb4-b091ef46de1d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:34.481318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0aafaabe-c2d6-4cf4-bbb4-b091ef46de1d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:34.483094 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0aafaabe-c2d6-4cf4-bbb4-b091ef46de1d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:34.487363 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0aafaabe-c2d6-4cf4-bbb4-b091ef46de1d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:34.489270 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0aafaabe-c2d6-4cf4-bbb4-b091ef46de1d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:34.793177 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-0aafaabe-c2d6-4cf4-bbb4-b091ef46de1d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:34.807654 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-0aafaabe-c2d6-4cf4-bbb4-b091ef46de1d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1284 microversion: 2.1 time: 0.360544 Oct 06 12:22:34.808455 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 25/43] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:34 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1284 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:22:35.433820 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-802a42db-9c6d-464f-b10c-51150b74b21d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:35.436012 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-802a42db-9c6d-464f-b10c-51150b74b21d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:35.460038 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-802a42db-9c6d-464f-b10c-51150b74b21d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:35.460968 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-802a42db-9c6d-464f-b10c-51150b74b21d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:35.463919 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-802a42db-9c6d-464f-b10c-51150b74b21d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:35.483904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1d1cd322-2486-40ae-9b7d-ef495ff44dbd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:35.484327 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-1d1cd322-2486-40ae-9b7d-ef495ff44dbd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:35.496652 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-802a42db-9c6d-464f-b10c-51150b74b21d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:35.500513 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-802a42db-9c6d-464f-b10c-51150b74b21d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:35.500995 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-802a42db-9c6d-464f-b10c-51150b74b21d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:35.510770 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1d1cd322-2486-40ae-9b7d-ef495ff44dbd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:35.514312 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1d1cd322-2486-40ae-9b7d-ef495ff44dbd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:35.515977 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1d1cd322-2486-40ae-9b7d-ef495ff44dbd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:35.517083 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1d1cd322-2486-40ae-9b7d-ef495ff44dbd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:35.521792 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1d1cd322-2486-40ae-9b7d-ef495ff44dbd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:35.522539 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1d1cd322-2486-40ae-9b7d-ef495ff44dbd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:36.029805 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-1d1cd322-2486-40ae-9b7d-ef495ff44dbd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:36.049934 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-1d1cd322-2486-40ae-9b7d-ef495ff44dbd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1234 microversion: 2.1 time: 0.565323 Oct 06 12:22:36.064117 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 26/44] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:35 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1234 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:22:36.082263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b6826275-fea8-4428-be23-d8019afa570f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:36.083318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b6826275-fea8-4428-be23-d8019afa570f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:36.091264 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6826275-fea8-4428-be23-d8019afa570f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:36.092874 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6826275-fea8-4428-be23-d8019afa570f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:36.093688 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6826275-fea8-4428-be23-d8019afa570f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:36.094496 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6826275-fea8-4428-be23-d8019afa570f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:36.095057 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6826275-fea8-4428-be23-d8019afa570f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:36.095722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6826275-fea8-4428-be23-d8019afa570f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:36.145999 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-802a42db-9c6d-464f-b10c-51150b74b21d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:36.159442 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-802a42db-9c6d-464f-b10c-51150b74b21d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1292 microversion: 2.1 time: 0.729689 Oct 06 12:22:36.160325 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 19/45] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:35 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1292 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:36.254192 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b6826275-fea8-4428-be23-d8019afa570f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:36.265534 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b6826275-fea8-4428-be23-d8019afa570f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1272 microversion: 2.1 time: 0.199411 Oct 06 12:22:36.268200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 27/46] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:36 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1272 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:37.077794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-811641d0-5c86-443b-9278-d7a31c1ea45e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:37.078493 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-811641d0-5c86-443b-9278-d7a31c1ea45e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:37.085624 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-811641d0-5c86-443b-9278-d7a31c1ea45e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:37.086360 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-811641d0-5c86-443b-9278-d7a31c1ea45e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:37.087624 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-811641d0-5c86-443b-9278-d7a31c1ea45e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:37.089087 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-811641d0-5c86-443b-9278-d7a31c1ea45e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:37.089553 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-811641d0-5c86-443b-9278-d7a31c1ea45e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:37.090252 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-811641d0-5c86-443b-9278-d7a31c1ea45e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:37.165116 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-811641d0-5c86-443b-9278-d7a31c1ea45e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:37.173161 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-811641d0-5c86-443b-9278-d7a31c1ea45e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1234 microversion: 2.1 time: 0.100008 Oct 06 12:22:37.173996 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 20/47] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:37 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1234 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:37.183212 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ee4c918b-350e-4fde-a2dc-586d8664294d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:37.185116 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ee4c918b-350e-4fde-a2dc-586d8664294d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:37.193974 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee4c918b-350e-4fde-a2dc-586d8664294d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:37.194769 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee4c918b-350e-4fde-a2dc-586d8664294d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:37.195436 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee4c918b-350e-4fde-a2dc-586d8664294d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:37.196921 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee4c918b-350e-4fde-a2dc-586d8664294d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:37.197894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee4c918b-350e-4fde-a2dc-586d8664294d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:37.197894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee4c918b-350e-4fde-a2dc-586d8664294d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:37.269623 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ee4c918b-350e-4fde-a2dc-586d8664294d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:37.278853 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ee4c918b-350e-4fde-a2dc-586d8664294d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1280 microversion: 2.1 time: 0.099345 Oct 06 12:22:37.279520 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 28/48] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:37 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1280 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:37.293756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2c3666fc-3806-4dca-9cfa-3b6ff84c2c4d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:37.295897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2c3666fc-3806-4dca-9cfa-3b6ff84c2c4d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:37.302525 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c3666fc-3806-4dca-9cfa-3b6ff84c2c4d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:37.303011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c3666fc-3806-4dca-9cfa-3b6ff84c2c4d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:37.303902 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c3666fc-3806-4dca-9cfa-3b6ff84c2c4d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:37.305083 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c3666fc-3806-4dca-9cfa-3b6ff84c2c4d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:37.305549 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c3666fc-3806-4dca-9cfa-3b6ff84c2c4d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:37.306015 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c3666fc-3806-4dca-9cfa-3b6ff84c2c4d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:37.470259 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2c3666fc-3806-4dca-9cfa-3b6ff84c2c4d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:37.485058 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2c3666fc-3806-4dca-9cfa-3b6ff84c2c4d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.197911 Oct 06 12:22:37.486129 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 21/49] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:37 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:38.199951 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a09d7385-28f3-4e66-b68d-c0108ad94e1d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:38.200635 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a09d7385-28f3-4e66-b68d-c0108ad94e1d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:38.206756 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a09d7385-28f3-4e66-b68d-c0108ad94e1d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:38.207255 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a09d7385-28f3-4e66-b68d-c0108ad94e1d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:38.208127 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a09d7385-28f3-4e66-b68d-c0108ad94e1d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:38.208444 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a09d7385-28f3-4e66-b68d-c0108ad94e1d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:38.208910 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a09d7385-28f3-4e66-b68d-c0108ad94e1d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:38.209339 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a09d7385-28f3-4e66-b68d-c0108ad94e1d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:38.303991 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d18838c2-c4e6-43e3-af93-02574795c343 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:38.304931 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d18838c2-c4e6-43e3-af93-02574795c343 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:38.316480 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d18838c2-c4e6-43e3-af93-02574795c343 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:38.318166 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d18838c2-c4e6-43e3-af93-02574795c343 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:38.319346 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d18838c2-c4e6-43e3-af93-02574795c343 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:38.320107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d18838c2-c4e6-43e3-af93-02574795c343 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:38.322147 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d18838c2-c4e6-43e3-af93-02574795c343 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:38.322766 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d18838c2-c4e6-43e3-af93-02574795c343 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:38.334844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a09d7385-28f3-4e66-b68d-c0108ad94e1d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:38.343691 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a09d7385-28f3-4e66-b68d-c0108ad94e1d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1234 microversion: 2.1 time: 0.149577 Oct 06 12:22:38.351556 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 29/50] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:38 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1234 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:38.398768 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d18838c2-c4e6-43e3-af93-02574795c343 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:38.406727 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d18838c2-c4e6-43e3-af93-02574795c343 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1280 microversion: 2.1 time: 0.108390 Oct 06 12:22:38.408329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 22/51] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:38 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1280 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:22:38.508699 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-08d98f61-1643-4c58-b1b9-8355a50c67fc tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:38.509736 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-08d98f61-1643-4c58-b1b9-8355a50c67fc tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:38.516981 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08d98f61-1643-4c58-b1b9-8355a50c67fc tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:38.517649 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08d98f61-1643-4c58-b1b9-8355a50c67fc tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:38.518093 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08d98f61-1643-4c58-b1b9-8355a50c67fc tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:38.518789 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08d98f61-1643-4c58-b1b9-8355a50c67fc tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:38.519249 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08d98f61-1643-4c58-b1b9-8355a50c67fc tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:38.519719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08d98f61-1643-4c58-b1b9-8355a50c67fc tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:38.660441 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-08d98f61-1643-4c58-b1b9-8355a50c67fc tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:38.669818 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-08d98f61-1643-4c58-b1b9-8355a50c67fc tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.164851 Oct 06 12:22:38.670575 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 30/52] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:38 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:39.368556 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-635c7388-0e45-4767-b601-0d626cde6f9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:39.369200 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-635c7388-0e45-4767-b601-0d626cde6f9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:39.376081 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-635c7388-0e45-4767-b601-0d626cde6f9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:39.376848 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-635c7388-0e45-4767-b601-0d626cde6f9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:39.377442 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-635c7388-0e45-4767-b601-0d626cde6f9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:39.378415 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-635c7388-0e45-4767-b601-0d626cde6f9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:39.379438 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-635c7388-0e45-4767-b601-0d626cde6f9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:39.380366 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-635c7388-0e45-4767-b601-0d626cde6f9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:39.437156 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2c829119-9a21-4a8d-a2f4-b4b682037caf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:39.440764 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2c829119-9a21-4a8d-a2f4-b4b682037caf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:39.461140 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2c829119-9a21-4a8d-a2f4-b4b682037caf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:39.462487 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2c829119-9a21-4a8d-a2f4-b4b682037caf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:39.463101 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2c829119-9a21-4a8d-a2f4-b4b682037caf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:39.464194 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2c829119-9a21-4a8d-a2f4-b4b682037caf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:39.464843 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2c829119-9a21-4a8d-a2f4-b4b682037caf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:39.465599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2c829119-9a21-4a8d-a2f4-b4b682037caf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:39.494834 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-635c7388-0e45-4767-b601-0d626cde6f9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:39.507300 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-635c7388-0e45-4767-b601-0d626cde6f9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1234 microversion: 2.1 time: 0.142590 Oct 06 12:22:39.507911 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 23/53] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:39 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1234 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:39.578823 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2c829119-9a21-4a8d-a2f4-b4b682037caf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:39.591694 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2c829119-9a21-4a8d-a2f4-b4b682037caf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1280 microversion: 2.1 time: 0.163708 Oct 06 12:22:39.592666 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 31/54] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:39 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1280 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:22:39.694470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2da9ab58-940c-4bfb-a510-c475a9a30bc3 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:39.694993 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2da9ab58-940c-4bfb-a510-c475a9a30bc3 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:39.701727 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2da9ab58-940c-4bfb-a510-c475a9a30bc3 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:39.702405 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2da9ab58-940c-4bfb-a510-c475a9a30bc3 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:39.703029 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2da9ab58-940c-4bfb-a510-c475a9a30bc3 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:39.703766 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2da9ab58-940c-4bfb-a510-c475a9a30bc3 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:39.704384 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2da9ab58-940c-4bfb-a510-c475a9a30bc3 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:39.704807 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2da9ab58-940c-4bfb-a510-c475a9a30bc3 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:39.906409 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2da9ab58-940c-4bfb-a510-c475a9a30bc3 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:39.918511 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2da9ab58-940c-4bfb-a510-c475a9a30bc3 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.228517 Oct 06 12:22:39.919101 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 24/55] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:39 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:40.537796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a23aea5d-7cc7-4753-98f4-ce4d3a168568 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:40.538422 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a23aea5d-7cc7-4753-98f4-ce4d3a168568 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:40.546551 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:40.552621 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a23aea5d-7cc7-4753-98f4-ce4d3a168568 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:40.553451 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a23aea5d-7cc7-4753-98f4-ce4d3a168568 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:40.554104 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a23aea5d-7cc7-4753-98f4-ce4d3a168568 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:40.555307 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a23aea5d-7cc7-4753-98f4-ce4d3a168568 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:40.555850 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a23aea5d-7cc7-4753-98f4-ce4d3a168568 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:40.556486 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a23aea5d-7cc7-4753-98f4-ce4d3a168568 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:40.617561 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-644f713a-ec11-475f-8348-82afb15ea158 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:40.618168 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-644f713a-ec11-475f-8348-82afb15ea158 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:40.624597 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-644f713a-ec11-475f-8348-82afb15ea158 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:40.628183 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-644f713a-ec11-475f-8348-82afb15ea158 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:40.628628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-644f713a-ec11-475f-8348-82afb15ea158 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:40.636509 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-644f713a-ec11-475f-8348-82afb15ea158 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:40.637748 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-644f713a-ec11-475f-8348-82afb15ea158 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:40.638328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-644f713a-ec11-475f-8348-82afb15ea158 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:40.653375 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a23aea5d-7cc7-4753-98f4-ce4d3a168568 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:40.661352 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a23aea5d-7cc7-4753-98f4-ce4d3a168568 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1234 microversion: 2.1 time: 0.127883 Oct 06 12:22:40.661930 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 32/56] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:40 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1234 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:40.705232 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-644f713a-ec11-475f-8348-82afb15ea158 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:40.713224 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-644f713a-ec11-475f-8348-82afb15ea158 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1280 microversion: 2.1 time: 0.100184 Oct 06 12:22:40.713807 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 25/57] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:40 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1280 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:40.942657 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5444522a-6df1-42c7-84f2-06b0bd4a0b69 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:40.943273 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5444522a-6df1-42c7-84f2-06b0bd4a0b69 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:40.949503 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5444522a-6df1-42c7-84f2-06b0bd4a0b69 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:40.950000 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5444522a-6df1-42c7-84f2-06b0bd4a0b69 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:40.950435 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5444522a-6df1-42c7-84f2-06b0bd4a0b69 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:40.951136 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5444522a-6df1-42c7-84f2-06b0bd4a0b69 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:40.951626 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5444522a-6df1-42c7-84f2-06b0bd4a0b69 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:40.952060 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5444522a-6df1-42c7-84f2-06b0bd4a0b69 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:41.118412 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5444522a-6df1-42c7-84f2-06b0bd4a0b69 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:41.126667 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5444522a-6df1-42c7-84f2-06b0bd4a0b69 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.188450 Oct 06 12:22:41.127158 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 33/58] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:40 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:41.685611 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5162c4f0-8fe3-40ff-b557-8cfde003ce1b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:41.686388 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5162c4f0-8fe3-40ff-b557-8cfde003ce1b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:41.688263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=6 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:41.693522 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5162c4f0-8fe3-40ff-b557-8cfde003ce1b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:41.694017 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5162c4f0-8fe3-40ff-b557-8cfde003ce1b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:41.694484 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5162c4f0-8fe3-40ff-b557-8cfde003ce1b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:41.695185 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5162c4f0-8fe3-40ff-b557-8cfde003ce1b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:41.695667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5162c4f0-8fe3-40ff-b557-8cfde003ce1b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:41.696096 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5162c4f0-8fe3-40ff-b557-8cfde003ce1b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:41.736587 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-81aa7a8d-f9d2-44fd-b0ab-7f6d53cfa85f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:41.737816 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-81aa7a8d-f9d2-44fd-b0ab-7f6d53cfa85f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:41.756304 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-81aa7a8d-f9d2-44fd-b0ab-7f6d53cfa85f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:41.757024 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-81aa7a8d-f9d2-44fd-b0ab-7f6d53cfa85f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:41.757621 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-81aa7a8d-f9d2-44fd-b0ab-7f6d53cfa85f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:41.758537 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-81aa7a8d-f9d2-44fd-b0ab-7f6d53cfa85f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:41.759410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-81aa7a8d-f9d2-44fd-b0ab-7f6d53cfa85f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:41.760208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-81aa7a8d-f9d2-44fd-b0ab-7f6d53cfa85f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:41.766769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5162c4f0-8fe3-40ff-b557-8cfde003ce1b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:41.775872 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5162c4f0-8fe3-40ff-b557-8cfde003ce1b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1234 microversion: 2.1 time: 0.094071 Oct 06 12:22:41.776458 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 26/59] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:41 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1234 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:41.853670 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-81aa7a8d-f9d2-44fd-b0ab-7f6d53cfa85f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:41.862810 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-81aa7a8d-f9d2-44fd-b0ab-7f6d53cfa85f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1280 microversion: 2.1 time: 0.130670 Oct 06 12:22:41.863642 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 34/60] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:41 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1280 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:42.158455 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4b5e9e41-4c6a-4982-8efe-b71656ebcd82 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:42.159133 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4b5e9e41-4c6a-4982-8efe-b71656ebcd82 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:42.161216 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=22 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:42.166576 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b5e9e41-4c6a-4982-8efe-b71656ebcd82 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:42.167035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b5e9e41-4c6a-4982-8efe-b71656ebcd82 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:42.167469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b5e9e41-4c6a-4982-8efe-b71656ebcd82 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:42.168205 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b5e9e41-4c6a-4982-8efe-b71656ebcd82 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:42.168658 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b5e9e41-4c6a-4982-8efe-b71656ebcd82 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:42.169079 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b5e9e41-4c6a-4982-8efe-b71656ebcd82 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:42.304920 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4b5e9e41-4c6a-4982-8efe-b71656ebcd82 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:42.313303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4b5e9e41-4c6a-4982-8efe-b71656ebcd82 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.158686 Oct 06 12:22:42.313803 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 27/61] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:42 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:42.806904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b58fb764-4e41-432f-bb22-9607c4f5cb81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:42.810565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b58fb764-4e41-432f-bb22-9607c4f5cb81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:42.813629 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=16 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:42.818026 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b58fb764-4e41-432f-bb22-9607c4f5cb81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:42.818532 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b58fb764-4e41-432f-bb22-9607c4f5cb81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:42.818973 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b58fb764-4e41-432f-bb22-9607c4f5cb81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:42.819719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b58fb764-4e41-432f-bb22-9607c4f5cb81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:42.820461 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b58fb764-4e41-432f-bb22-9607c4f5cb81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:42.820838 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b58fb764-4e41-432f-bb22-9607c4f5cb81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:42.889597 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b58fb764-4e41-432f-bb22-9607c4f5cb81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:42.896849 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-21984254-12d7-4dd0-8023-4dccbd03f600 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:42.897974 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b58fb764-4e41-432f-bb22-9607c4f5cb81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1234 microversion: 2.1 time: 0.101015 Oct 06 12:22:42.898406 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-21984254-12d7-4dd0-8023-4dccbd03f600 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:42.899137 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 35/62] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:42 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1234 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:42.924932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-21984254-12d7-4dd0-8023-4dccbd03f600 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:42.925420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-21984254-12d7-4dd0-8023-4dccbd03f600 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:42.932090 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-21984254-12d7-4dd0-8023-4dccbd03f600 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:42.933588 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-21984254-12d7-4dd0-8023-4dccbd03f600 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:42.934058 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-21984254-12d7-4dd0-8023-4dccbd03f600 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:42.934488 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-21984254-12d7-4dd0-8023-4dccbd03f600 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:43.050219 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-21984254-12d7-4dd0-8023-4dccbd03f600 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:43.062488 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-21984254-12d7-4dd0-8023-4dccbd03f600 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1280 microversion: 2.1 time: 0.171025 Oct 06 12:22:43.063090 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 28/63] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:42 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1280 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:43.337489 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6d3c689a-33c5-4faf-8ce2-187254b2168e tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:43.338274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-6d3c689a-33c5-4faf-8ce2-187254b2168e tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:43.347358 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6d3c689a-33c5-4faf-8ce2-187254b2168e tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:43.348041 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6d3c689a-33c5-4faf-8ce2-187254b2168e tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:43.348658 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6d3c689a-33c5-4faf-8ce2-187254b2168e tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:43.349498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6d3c689a-33c5-4faf-8ce2-187254b2168e tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:43.350280 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6d3c689a-33c5-4faf-8ce2-187254b2168e tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:43.350871 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6d3c689a-33c5-4faf-8ce2-187254b2168e tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:43.566751 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6d3c689a-33c5-4faf-8ce2-187254b2168e tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:43.575190 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-6d3c689a-33c5-4faf-8ce2-187254b2168e tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.242043 Oct 06 12:22:43.575808 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 36/64] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:43 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:43.925197 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-89194fed-534b-4cd5-a37d-33bbe16f4698 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:43.925812 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-89194fed-534b-4cd5-a37d-33bbe16f4698 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:43.934972 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-89194fed-534b-4cd5-a37d-33bbe16f4698 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:43.935472 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-89194fed-534b-4cd5-a37d-33bbe16f4698 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:43.938575 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-89194fed-534b-4cd5-a37d-33bbe16f4698 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:43.939275 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-89194fed-534b-4cd5-a37d-33bbe16f4698 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:43.939943 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-89194fed-534b-4cd5-a37d-33bbe16f4698 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:43.940527 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-89194fed-534b-4cd5-a37d-33bbe16f4698 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:44.019227 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-89194fed-534b-4cd5-a37d-33bbe16f4698 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:44.028566 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-89194fed-534b-4cd5-a37d-33bbe16f4698 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1234 microversion: 2.1 time: 0.107830 Oct 06 12:22:44.029379 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 29/65] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:43 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1234 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:44.089046 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5d06d3f5-7135-4f43-b1f8-80cab79519e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:44.089706 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5d06d3f5-7135-4f43-b1f8-80cab79519e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:44.095916 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5d06d3f5-7135-4f43-b1f8-80cab79519e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:44.096406 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5d06d3f5-7135-4f43-b1f8-80cab79519e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:44.097029 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5d06d3f5-7135-4f43-b1f8-80cab79519e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:44.099276 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5d06d3f5-7135-4f43-b1f8-80cab79519e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:44.099276 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5d06d3f5-7135-4f43-b1f8-80cab79519e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:44.099276 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5d06d3f5-7135-4f43-b1f8-80cab79519e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:44.185537 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5d06d3f5-7135-4f43-b1f8-80cab79519e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:44.194708 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5d06d3f5-7135-4f43-b1f8-80cab79519e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1280 microversion: 2.1 time: 0.109958 Oct 06 12:22:44.195613 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 37/66] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:44 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1280 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:44.598971 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-425b63d8-5170-4e35-ab92-5728dd961b38 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:44.600050 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-425b63d8-5170-4e35-ab92-5728dd961b38 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:44.606400 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-425b63d8-5170-4e35-ab92-5728dd961b38 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:44.607472 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-425b63d8-5170-4e35-ab92-5728dd961b38 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:44.608248 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-425b63d8-5170-4e35-ab92-5728dd961b38 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:44.609439 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-425b63d8-5170-4e35-ab92-5728dd961b38 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:44.612625 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-425b63d8-5170-4e35-ab92-5728dd961b38 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:44.613761 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-425b63d8-5170-4e35-ab92-5728dd961b38 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:44.652043 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=100 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:44.905272 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-425b63d8-5170-4e35-ab92-5728dd961b38 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:44.913781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-425b63d8-5170-4e35-ab92-5728dd961b38 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.319041 Oct 06 12:22:44.924177 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 30/67] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:44 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:22:45.052961 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-da05457d-1182-486c-a41c-cfe2244518ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:45.053737 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-da05457d-1182-486c-a41c-cfe2244518ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:45.066721 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da05457d-1182-486c-a41c-cfe2244518ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:45.071474 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da05457d-1182-486c-a41c-cfe2244518ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:45.072166 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da05457d-1182-486c-a41c-cfe2244518ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:45.073122 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da05457d-1182-486c-a41c-cfe2244518ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:45.073767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da05457d-1182-486c-a41c-cfe2244518ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:45.074853 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da05457d-1182-486c-a41c-cfe2244518ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:45.221460 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-853334ca-bd4c-4a98-89d7-edf53db9babd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:45.222245 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-853334ca-bd4c-4a98-89d7-edf53db9babd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:45.229788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-853334ca-bd4c-4a98-89d7-edf53db9babd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:45.243106 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-853334ca-bd4c-4a98-89d7-edf53db9babd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:45.243979 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-853334ca-bd4c-4a98-89d7-edf53db9babd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:45.244852 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-853334ca-bd4c-4a98-89d7-edf53db9babd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:45.245413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-853334ca-bd4c-4a98-89d7-edf53db9babd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:45.245981 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-853334ca-bd4c-4a98-89d7-edf53db9babd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:45.250840 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-da05457d-1182-486c-a41c-cfe2244518ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:45.259907 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-da05457d-1182-486c-a41c-cfe2244518ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1234 microversion: 2.1 time: 0.211468 Oct 06 12:22:45.267552 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 38/68] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:45 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1234 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:45.645610 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-853334ca-bd4c-4a98-89d7-edf53db9babd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:45.655875 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-853334ca-bd4c-4a98-89d7-edf53db9babd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1280 microversion: 2.1 time: 0.438305 Oct 06 12:22:45.663405 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 31/69] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:45 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1280 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:45.938953 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-224b156e-a04e-4b62-90da-1606073bf6d1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:45.940116 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-224b156e-a04e-4b62-90da-1606073bf6d1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:45.956618 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-224b156e-a04e-4b62-90da-1606073bf6d1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:45.957139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-224b156e-a04e-4b62-90da-1606073bf6d1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:45.957584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-224b156e-a04e-4b62-90da-1606073bf6d1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:45.958305 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-224b156e-a04e-4b62-90da-1606073bf6d1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:45.958767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-224b156e-a04e-4b62-90da-1606073bf6d1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:45.959197 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-224b156e-a04e-4b62-90da-1606073bf6d1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:45.973044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=100 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:46.302597 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f91edaf3-9f50-4b46-ac2a-3eee56993c3d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:46.306781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f91edaf3-9f50-4b46-ac2a-3eee56993c3d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:46.320209 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f91edaf3-9f50-4b46-ac2a-3eee56993c3d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:46.321906 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f91edaf3-9f50-4b46-ac2a-3eee56993c3d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:46.323068 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f91edaf3-9f50-4b46-ac2a-3eee56993c3d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:46.326563 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f91edaf3-9f50-4b46-ac2a-3eee56993c3d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:46.327244 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f91edaf3-9f50-4b46-ac2a-3eee56993c3d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:46.330497 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f91edaf3-9f50-4b46-ac2a-3eee56993c3d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:46.442154 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f91edaf3-9f50-4b46-ac2a-3eee56993c3d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:46.448633 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-224b156e-a04e-4b62-90da-1606073bf6d1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:46.453033 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f91edaf3-9f50-4b46-ac2a-3eee56993c3d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1234 microversion: 2.1 time: 0.162896 Oct 06 12:22:46.470641 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-224b156e-a04e-4b62-90da-1606073bf6d1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.533220 Oct 06 12:22:46.472270 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 32/70] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:46 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1234 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:46.473828 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 39/71] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:45 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:46.689074 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-31db8736-2228-4e84-8840-1a23bb0ce83a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:46.690874 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-31db8736-2228-4e84-8840-1a23bb0ce83a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:46.702872 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-31db8736-2228-4e84-8840-1a23bb0ce83a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:46.707436 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-31db8736-2228-4e84-8840-1a23bb0ce83a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:46.720903 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-31db8736-2228-4e84-8840-1a23bb0ce83a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:46.726127 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-31db8736-2228-4e84-8840-1a23bb0ce83a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:46.735142 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-31db8736-2228-4e84-8840-1a23bb0ce83a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:46.737026 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-31db8736-2228-4e84-8840-1a23bb0ce83a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:46.939384 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-31db8736-2228-4e84-8840-1a23bb0ce83a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:46.948125 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-31db8736-2228-4e84-8840-1a23bb0ce83a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1280 microversion: 2.1 time: 0.267149 Oct 06 12:22:46.952224 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 33/72] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:46 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:47.478430 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a2a43911-32c7-4f5e-bdc7-748b65fdd823 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:47.479689 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a2a43911-32c7-4f5e-bdc7-748b65fdd823 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:47.492527 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a2a43911-32c7-4f5e-bdc7-748b65fdd823 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:47.493397 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a2a43911-32c7-4f5e-bdc7-748b65fdd823 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:47.493931 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a2a43911-32c7-4f5e-bdc7-748b65fdd823 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:47.494869 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a2a43911-32c7-4f5e-bdc7-748b65fdd823 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:47.497632 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a2a43911-32c7-4f5e-bdc7-748b65fdd823 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:47.498603 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a2a43911-32c7-4f5e-bdc7-748b65fdd823 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:47.508510 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5e33a7fd-e511-4578-a7a6-1101cb6da963 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:47.509063 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5e33a7fd-e511-4578-a7a6-1101cb6da963 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:47.525215 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5e33a7fd-e511-4578-a7a6-1101cb6da963 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:47.525830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5e33a7fd-e511-4578-a7a6-1101cb6da963 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:47.526349 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5e33a7fd-e511-4578-a7a6-1101cb6da963 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:47.527104 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5e33a7fd-e511-4578-a7a6-1101cb6da963 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:47.527690 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5e33a7fd-e511-4578-a7a6-1101cb6da963 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:47.528288 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5e33a7fd-e511-4578-a7a6-1101cb6da963 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:47.583929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a2a43911-32c7-4f5e-bdc7-748b65fdd823 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:47.594822 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a2a43911-32c7-4f5e-bdc7-748b65fdd823 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1234 microversion: 2.1 time: 0.120288 Oct 06 12:22:47.599589 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 40/73] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:47 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1234 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:47.774097 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5e33a7fd-e511-4578-a7a6-1101cb6da963 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:47.787366 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5e33a7fd-e511-4578-a7a6-1101cb6da963 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.288132 Oct 06 12:22:47.788505 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 34/74] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:47 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:22:47.977288 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c3960384-c103-4928-82bb-501b149b76c1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:47.977907 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c3960384-c103-4928-82bb-501b149b76c1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:47.987191 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3960384-c103-4928-82bb-501b149b76c1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:47.988011 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3960384-c103-4928-82bb-501b149b76c1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:47.988411 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3960384-c103-4928-82bb-501b149b76c1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:47.989109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3960384-c103-4928-82bb-501b149b76c1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:47.989716 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3960384-c103-4928-82bb-501b149b76c1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:47.990331 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3960384-c103-4928-82bb-501b149b76c1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:48.085518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c3960384-c103-4928-82bb-501b149b76c1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:48.096479 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c3960384-c103-4928-82bb-501b149b76c1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1280 microversion: 2.1 time: 0.122293 Oct 06 12:22:48.097099 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 41/75] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:47 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1280 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:48.619746 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-245ea6c0-abd3-4e98-9ad3-9de2f0849018 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:48.620360 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-245ea6c0-abd3-4e98-9ad3-9de2f0849018 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:48.632157 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:48.637982 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-245ea6c0-abd3-4e98-9ad3-9de2f0849018 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:48.638928 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-245ea6c0-abd3-4e98-9ad3-9de2f0849018 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:48.639489 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-245ea6c0-abd3-4e98-9ad3-9de2f0849018 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:48.640719 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-245ea6c0-abd3-4e98-9ad3-9de2f0849018 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:48.641416 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-245ea6c0-abd3-4e98-9ad3-9de2f0849018 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:48.642125 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-245ea6c0-abd3-4e98-9ad3-9de2f0849018 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:48.753975 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-245ea6c0-abd3-4e98-9ad3-9de2f0849018 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:48.766452 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-245ea6c0-abd3-4e98-9ad3-9de2f0849018 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1234 microversion: 2.1 time: 0.151371 Oct 06 12:22:48.767815 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 35/76] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:48 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1234 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:48.812252 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-809f1600-4114-48fc-be42-a7db58ee956f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:48.814395 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-809f1600-4114-48fc-be42-a7db58ee956f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:48.823557 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-809f1600-4114-48fc-be42-a7db58ee956f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:48.825010 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-809f1600-4114-48fc-be42-a7db58ee956f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:48.825791 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-809f1600-4114-48fc-be42-a7db58ee956f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:48.827751 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-809f1600-4114-48fc-be42-a7db58ee956f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:48.828438 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-809f1600-4114-48fc-be42-a7db58ee956f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:48.829668 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-809f1600-4114-48fc-be42-a7db58ee956f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:49.003133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-809f1600-4114-48fc-be42-a7db58ee956f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:49.011008 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-809f1600-4114-48fc-be42-a7db58ee956f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.203743 Oct 06 12:22:49.012309 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 42/77] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:48 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:49.121545 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3fde61c0-7cd9-4105-8ebb-f244274bc400 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:49.123124 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3fde61c0-7cd9-4105-8ebb-f244274bc400 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:49.132941 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3fde61c0-7cd9-4105-8ebb-f244274bc400 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:49.136817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3fde61c0-7cd9-4105-8ebb-f244274bc400 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:49.137439 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3fde61c0-7cd9-4105-8ebb-f244274bc400 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:49.138938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3fde61c0-7cd9-4105-8ebb-f244274bc400 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:49.139886 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3fde61c0-7cd9-4105-8ebb-f244274bc400 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:49.140560 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3fde61c0-7cd9-4105-8ebb-f244274bc400 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:49.230416 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3fde61c0-7cd9-4105-8ebb-f244274bc400 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:49.243080 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3fde61c0-7cd9-4105-8ebb-f244274bc400 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1280 microversion: 2.1 time: 0.126656 Oct 06 12:22:49.244068 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 36/78] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:49 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1280 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:49.790278 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0c4157c2-0b88-4533-9685-473258410c88 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:49.790860 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-0c4157c2-0b88-4533-9685-473258410c88 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:49.814741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0c4157c2-0b88-4533-9685-473258410c88 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:49.815327 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0c4157c2-0b88-4533-9685-473258410c88 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:49.815724 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0c4157c2-0b88-4533-9685-473258410c88 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:49.816425 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0c4157c2-0b88-4533-9685-473258410c88 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:49.816891 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0c4157c2-0b88-4533-9685-473258410c88 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:49.817321 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0c4157c2-0b88-4533-9685-473258410c88 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:49.936841 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-0c4157c2-0b88-4533-9685-473258410c88 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:49.946189 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-0c4157c2-0b88-4533-9685-473258410c88 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1234 microversion: 2.1 time: 0.159693 Oct 06 12:22:49.947044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 43/79] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:49 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1234 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:50.034303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e40cfbcb-dc74-46d0-b177-4f2609a929da tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:50.035216 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e40cfbcb-dc74-46d0-b177-4f2609a929da tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:50.041955 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e40cfbcb-dc74-46d0-b177-4f2609a929da tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:50.042808 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e40cfbcb-dc74-46d0-b177-4f2609a929da tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:50.043441 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e40cfbcb-dc74-46d0-b177-4f2609a929da tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:50.044542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e40cfbcb-dc74-46d0-b177-4f2609a929da tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:50.045020 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e40cfbcb-dc74-46d0-b177-4f2609a929da tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:50.045411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e40cfbcb-dc74-46d0-b177-4f2609a929da tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:50.268202 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e4d6e254-1aef-4cd7-bd92-26e84dede048 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:50.269558 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e4d6e254-1aef-4cd7-bd92-26e84dede048 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:50.278068 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e4d6e254-1aef-4cd7-bd92-26e84dede048 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:50.278877 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e4d6e254-1aef-4cd7-bd92-26e84dede048 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:50.279527 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e4d6e254-1aef-4cd7-bd92-26e84dede048 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:50.280406 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e4d6e254-1aef-4cd7-bd92-26e84dede048 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:50.281210 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e4d6e254-1aef-4cd7-bd92-26e84dede048 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:50.281932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e4d6e254-1aef-4cd7-bd92-26e84dede048 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:50.409283 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e40cfbcb-dc74-46d0-b177-4f2609a929da tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:50.423113 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e40cfbcb-dc74-46d0-b177-4f2609a929da tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.390368 Oct 06 12:22:50.439247 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 37/80] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:50 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:50.475943 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e4d6e254-1aef-4cd7-bd92-26e84dede048 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:50.496271 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e4d6e254-1aef-4cd7-bd92-26e84dede048 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1280 microversion: 2.1 time: 0.231544 Oct 06 12:22:50.512041 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 44/81] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:50 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1280 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:50.979869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-68e6c165-b155-4d85-81f0-047ea1bab477 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:50.980889 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-68e6c165-b155-4d85-81f0-047ea1bab477 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:51.021696 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-68e6c165-b155-4d85-81f0-047ea1bab477 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:51.022225 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-68e6c165-b155-4d85-81f0-047ea1bab477 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:51.022667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-68e6c165-b155-4d85-81f0-047ea1bab477 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:51.028874 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-68e6c165-b155-4d85-81f0-047ea1bab477 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:51.031252 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-68e6c165-b155-4d85-81f0-047ea1bab477 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:51.034467 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-68e6c165-b155-4d85-81f0-047ea1bab477 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:51.186300 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-68e6c165-b155-4d85-81f0-047ea1bab477 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:51.220307 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-68e6c165-b155-4d85-81f0-047ea1bab477 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1290 microversion: 2.1 time: 0.251966 Oct 06 12:22:51.223349 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 38/82] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:50 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1290 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:51.459892 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-62739316-b36d-4051-a39f-77495b7ffbb7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:51.467025 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-62739316-b36d-4051-a39f-77495b7ffbb7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:51.491077 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-62739316-b36d-4051-a39f-77495b7ffbb7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:51.491723 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-62739316-b36d-4051-a39f-77495b7ffbb7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:51.492171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-62739316-b36d-4051-a39f-77495b7ffbb7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:51.493004 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-62739316-b36d-4051-a39f-77495b7ffbb7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:51.493468 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-62739316-b36d-4051-a39f-77495b7ffbb7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:51.493997 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-62739316-b36d-4051-a39f-77495b7ffbb7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:51.534981 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a35b6e18-45e2-496a-8a69-8e4bbcaca827 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:51.535797 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a35b6e18-45e2-496a-8a69-8e4bbcaca827 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:51.579861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a35b6e18-45e2-496a-8a69-8e4bbcaca827 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:51.580360 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a35b6e18-45e2-496a-8a69-8e4bbcaca827 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:51.592136 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a35b6e18-45e2-496a-8a69-8e4bbcaca827 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:51.592921 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a35b6e18-45e2-496a-8a69-8e4bbcaca827 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:51.601373 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a35b6e18-45e2-496a-8a69-8e4bbcaca827 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:51.604202 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a35b6e18-45e2-496a-8a69-8e4bbcaca827 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:52.311193 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-62739316-b36d-4051-a39f-77495b7ffbb7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:52.324456 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-62739316-b36d-4051-a39f-77495b7ffbb7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.876973 Oct 06 12:22:52.325045 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 45/83] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:51 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:52.333855 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3610182c-a2b0-4776-b0e7-198768649f84 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:52.334532 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3610182c-a2b0-4776-b0e7-198768649f84 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:52.347483 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3610182c-a2b0-4776-b0e7-198768649f84 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:52.348260 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3610182c-a2b0-4776-b0e7-198768649f84 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:52.348696 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3610182c-a2b0-4776-b0e7-198768649f84 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:52.349423 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3610182c-a2b0-4776-b0e7-198768649f84 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:52.349876 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3610182c-a2b0-4776-b0e7-198768649f84 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:52.350301 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3610182c-a2b0-4776-b0e7-198768649f84 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:52.625803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3610182c-a2b0-4776-b0e7-198768649f84 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:52.638972 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3610182c-a2b0-4776-b0e7-198768649f84 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1296 microversion: 2.1 time: 0.312871 Oct 06 12:22:52.639577 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 46/84] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:52 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1296 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:52.676010 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a35b6e18-45e2-496a-8a69-8e4bbcaca827 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:52.689351 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a35b6e18-45e2-496a-8a69-8e4bbcaca827 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 1.166706 Oct 06 12:22:52.691213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 39/85] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:51 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:53.355968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2a0518a4-c44a-4eee-b29b-4ca81bf9eefa tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:53.356720 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2a0518a4-c44a-4eee-b29b-4ca81bf9eefa tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:53.359900 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:53.365037 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2a0518a4-c44a-4eee-b29b-4ca81bf9eefa tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:53.367258 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2a0518a4-c44a-4eee-b29b-4ca81bf9eefa tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:53.368728 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2a0518a4-c44a-4eee-b29b-4ca81bf9eefa tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:53.371011 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2a0518a4-c44a-4eee-b29b-4ca81bf9eefa tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:53.372647 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2a0518a4-c44a-4eee-b29b-4ca81bf9eefa tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:53.373715 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2a0518a4-c44a-4eee-b29b-4ca81bf9eefa tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:53.663212 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-bef8a5e0-2879-4a2d-b211-c9f5ac384ce6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:53.664209 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-bef8a5e0-2879-4a2d-b211-c9f5ac384ce6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:53.674385 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bef8a5e0-2879-4a2d-b211-c9f5ac384ce6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:53.676206 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bef8a5e0-2879-4a2d-b211-c9f5ac384ce6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:53.677514 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bef8a5e0-2879-4a2d-b211-c9f5ac384ce6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:53.678571 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bef8a5e0-2879-4a2d-b211-c9f5ac384ce6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:53.679210 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bef8a5e0-2879-4a2d-b211-c9f5ac384ce6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:53.679873 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bef8a5e0-2879-4a2d-b211-c9f5ac384ce6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:53.981466 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-bef8a5e0-2879-4a2d-b211-c9f5ac384ce6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:53.998975 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-bef8a5e0-2879-4a2d-b211-c9f5ac384ce6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1296 microversion: 2.1 time: 0.340477 Oct 06 12:22:54.001599 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 40/86] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:53 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1296 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:22:54.008487 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b694f4d5-bff7-4f4b-9164-f124b6e66966 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:54.010490 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b694f4d5-bff7-4f4b-9164-f124b6e66966 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:54.018300 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b694f4d5-bff7-4f4b-9164-f124b6e66966 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:54.019674 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b694f4d5-bff7-4f4b-9164-f124b6e66966 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:54.021198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b694f4d5-bff7-4f4b-9164-f124b6e66966 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:54.022190 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b694f4d5-bff7-4f4b-9164-f124b6e66966 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:54.022856 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b694f4d5-bff7-4f4b-9164-f124b6e66966 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:54.023530 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b694f4d5-bff7-4f4b-9164-f124b6e66966 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:54.414366 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2a0518a4-c44a-4eee-b29b-4ca81bf9eefa tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:54.427305 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2a0518a4-c44a-4eee-b29b-4ca81bf9eefa tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 1.075617 Oct 06 12:22:54.428564 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 47/87] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:53 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:54.562752 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-75dcdfb7-3a85-427d-9cf0-2f620d1eb775 req-1378f969-1415-4ab9-8fab-74fab66b3e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "518de8e1-7379-4cc4-98da-0f042318420b", "tag": "b3316e74-8f06-454a-ad05-4f9d36155fe9"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:22:54.590487 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-75dcdfb7-3a85-427d-9cf0-2f620d1eb775 req-1378f969-1415-4ab9-8fab-74fab66b3e9c service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:54.591241 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-75dcdfb7-3a85-427d-9cf0-2f620d1eb775 req-1378f969-1415-4ab9-8fab-74fab66b3e9c service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:54.591931 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-75dcdfb7-3a85-427d-9cf0-2f620d1eb775 req-1378f969-1415-4ab9-8fab-74fab66b3e9c service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:54.617783 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-75dcdfb7-3a85-427d-9cf0-2f620d1eb775 req-1378f969-1415-4ab9-8fab-74fab66b3e9c service nova] Creating event network-changed:b3316e74-8f06-454a-ad05-4f9d36155fe9 for instance 518de8e1-7379-4cc4-98da-0f042318420b on hv-cinder-85604 Oct 06 12:22:54.618565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-75dcdfb7-3a85-427d-9cf0-2f620d1eb775 req-1378f969-1415-4ab9-8fab-74fab66b3e9c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120508) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 12:22:54.619633 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-75dcdfb7-3a85-427d-9cf0-2f620d1eb775 req-1378f969-1415-4ab9-8fab-74fab66b3e9c service nova] Acquired lock "compute-rpcapi-router" {{(pid=120508) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 12:22:54.621761 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-641d7d52-a068-41ce-9d0b-269f02ad1054 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:54.622503 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-641d7d52-a068-41ce-9d0b-269f02ad1054 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:54.623146 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-641d7d52-a068-41ce-9d0b-269f02ad1054 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:54.624309 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-641d7d52-a068-41ce-9d0b-269f02ad1054 None None] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:54.625216 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-641d7d52-a068-41ce-9d0b-269f02ad1054 None None] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:54.626052 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-641d7d52-a068-41ce-9d0b-269f02ad1054 None None] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:54.637561 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.compute.rpcapi [None req-641d7d52-a068-41ce-9d0b-269f02ad1054 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 06 12:22:54.638873 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-641d7d52-a068-41ce-9d0b-269f02ad1054 None None] Releasing lock "compute-rpcapi-router" {{(pid=120508) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 12:22:54.668585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-641d7d52-a068-41ce-9d0b-269f02ad1054 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237155 Oct 06 12:22:54.670204 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 48/88] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:22:54.791416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-bae17faf-9ff7-4134-a246-a17a3f0145e5 req-436c4b11-34b2-469e-8f47-9e33e42e333a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bdd2944-b97f-40e0-a1cb-915cea031265", "tag": "9e7b0b39-c340-4a59-8b3a-a243b300266f"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:22:54.817525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-bae17faf-9ff7-4134-a246-a17a3f0145e5 req-436c4b11-34b2-469e-8f47-9e33e42e333a service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:54.823886 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-bae17faf-9ff7-4134-a246-a17a3f0145e5 req-436c4b11-34b2-469e-8f47-9e33e42e333a service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:54.824945 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-bae17faf-9ff7-4134-a246-a17a3f0145e5 req-436c4b11-34b2-469e-8f47-9e33e42e333a service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:54.843718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-bae17faf-9ff7-4134-a246-a17a3f0145e5 req-436c4b11-34b2-469e-8f47-9e33e42e333a service nova] Creating event network-changed:9e7b0b39-c340-4a59-8b3a-a243b300266f for instance 6bdd2944-b97f-40e0-a1cb-915cea031265 on hv-cinder-85604 Oct 06 12:22:54.850502 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b694f4d5-bff7-4f4b-9164-f124b6e66966 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:54.860746 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b694f4d5-bff7-4f4b-9164-f124b6e66966 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.856488 Oct 06 12:22:54.863838 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 41/89] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:54 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:54.872655 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-bae17faf-9ff7-4134-a246-a17a3f0145e5 req-436c4b11-34b2-469e-8f47-9e33e42e333a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198797 Oct 06 12:22:54.874028 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 49/90] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:22:55.029328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-acfc4232-16b5-42a8-8b65-5fffe72298f9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:55.030783 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-acfc4232-16b5-42a8-8b65-5fffe72298f9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:55.051204 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-acfc4232-16b5-42a8-8b65-5fffe72298f9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:55.051733 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-acfc4232-16b5-42a8-8b65-5fffe72298f9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:55.052470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-acfc4232-16b5-42a8-8b65-5fffe72298f9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:55.053354 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-acfc4232-16b5-42a8-8b65-5fffe72298f9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:55.053945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-acfc4232-16b5-42a8-8b65-5fffe72298f9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:55.054509 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-acfc4232-16b5-42a8-8b65-5fffe72298f9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:55.357756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-acfc4232-16b5-42a8-8b65-5fffe72298f9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:55.366297 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-acfc4232-16b5-42a8-8b65-5fffe72298f9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.342737 Oct 06 12:22:55.371603 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 42/91] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:55 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:55.455982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1d2c800e-af81-4200-942b-ddad76630666 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:55.456839 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-1d2c800e-af81-4200-942b-ddad76630666 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:55.464456 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1d2c800e-af81-4200-942b-ddad76630666 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:55.465295 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1d2c800e-af81-4200-942b-ddad76630666 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:55.469003 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1d2c800e-af81-4200-942b-ddad76630666 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:55.470175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1d2c800e-af81-4200-942b-ddad76630666 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:55.471635 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1d2c800e-af81-4200-942b-ddad76630666 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:55.472560 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1d2c800e-af81-4200-942b-ddad76630666 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:55.673676 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-1d2c800e-af81-4200-942b-ddad76630666 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:55.682920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-1d2c800e-af81-4200-942b-ddad76630666 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.231067 Oct 06 12:22:55.699616 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 50/92] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:55 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:55.892136 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7861af7f-51ef-4ec8-9d87-6c2af1b677cc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:55.892779 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7861af7f-51ef-4ec8-9d87-6c2af1b677cc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:55.899677 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7861af7f-51ef-4ec8-9d87-6c2af1b677cc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:55.900471 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7861af7f-51ef-4ec8-9d87-6c2af1b677cc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:55.901002 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7861af7f-51ef-4ec8-9d87-6c2af1b677cc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:55.902403 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7861af7f-51ef-4ec8-9d87-6c2af1b677cc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:55.902856 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7861af7f-51ef-4ec8-9d87-6c2af1b677cc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:55.903284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7861af7f-51ef-4ec8-9d87-6c2af1b677cc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:56.121456 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7861af7f-51ef-4ec8-9d87-6c2af1b677cc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:56.129840 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7861af7f-51ef-4ec8-9d87-6c2af1b677cc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.241552 Oct 06 12:22:56.130648 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 43/93] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:55 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:56.393569 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-700bc88d-2d06-43ca-be64-d3f6896805a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:56.394186 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-700bc88d-2d06-43ca-be64-d3f6896805a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:56.403938 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-700bc88d-2d06-43ca-be64-d3f6896805a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:56.404433 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-700bc88d-2d06-43ca-be64-d3f6896805a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:56.404869 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-700bc88d-2d06-43ca-be64-d3f6896805a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:56.405569 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-700bc88d-2d06-43ca-be64-d3f6896805a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:56.406047 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-700bc88d-2d06-43ca-be64-d3f6896805a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:56.406475 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-700bc88d-2d06-43ca-be64-d3f6896805a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:56.647377 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-700bc88d-2d06-43ca-be64-d3f6896805a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:56.659321 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-700bc88d-2d06-43ca-be64-d3f6896805a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.269459 Oct 06 12:22:56.661279 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 51/94] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:56 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:56.719779 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-eb1b8fa0-ab73-4869-8adb-5f1c6293123a req-302758d6-9221-4583-b2b0-9bfceef2835e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1ff3ab6-55a2-45ae-a912-59faf8868070", "tag": "180aaafa-49f4-4890-afea-eb300c2b071f"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:22:56.720360 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-92e8eeb7-5393-46f7-a503-8344f9c2b4c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:56.722107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-92e8eeb7-5393-46f7-a503-8344f9c2b4c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:56.730394 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-92e8eeb7-5393-46f7-a503-8344f9c2b4c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:56.730886 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-92e8eeb7-5393-46f7-a503-8344f9c2b4c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:56.731329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-92e8eeb7-5393-46f7-a503-8344f9c2b4c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:56.732230 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-92e8eeb7-5393-46f7-a503-8344f9c2b4c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:56.732759 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-92e8eeb7-5393-46f7-a503-8344f9c2b4c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:56.733356 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-92e8eeb7-5393-46f7-a503-8344f9c2b4c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:56.744314 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-eb1b8fa0-ab73-4869-8adb-5f1c6293123a req-302758d6-9221-4583-b2b0-9bfceef2835e service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:56.746412 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-eb1b8fa0-ab73-4869-8adb-5f1c6293123a req-302758d6-9221-4583-b2b0-9bfceef2835e service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:56.747086 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-eb1b8fa0-ab73-4869-8adb-5f1c6293123a req-302758d6-9221-4583-b2b0-9bfceef2835e service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:56.765228 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-eb1b8fa0-ab73-4869-8adb-5f1c6293123a req-302758d6-9221-4583-b2b0-9bfceef2835e service nova] Creating event network-changed:180aaafa-49f4-4890-afea-eb300c2b071f for instance d1ff3ab6-55a2-45ae-a912-59faf8868070 on hv-cinder-85604 Oct 06 12:22:56.773082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-eb1b8fa0-ab73-4869-8adb-5f1c6293123a req-302758d6-9221-4583-b2b0-9bfceef2835e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059195 Oct 06 12:22:56.774017 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 52/95] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:22:56.906111 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-92e8eeb7-5393-46f7-a503-8344f9c2b4c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:56.914499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-92e8eeb7-5393-46f7-a503-8344f9c2b4c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.211950 Oct 06 12:22:56.916120 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 44/96] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:56 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:57.157141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-63d5e865-89a6-4cfc-bc46-90bc68f6d60c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:57.158316 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-63d5e865-89a6-4cfc-bc46-90bc68f6d60c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:57.167562 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63d5e865-89a6-4cfc-bc46-90bc68f6d60c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:57.168762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63d5e865-89a6-4cfc-bc46-90bc68f6d60c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:57.169726 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63d5e865-89a6-4cfc-bc46-90bc68f6d60c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:57.170836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63d5e865-89a6-4cfc-bc46-90bc68f6d60c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:57.171464 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63d5e865-89a6-4cfc-bc46-90bc68f6d60c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:57.172143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63d5e865-89a6-4cfc-bc46-90bc68f6d60c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:57.436289 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-63d5e865-89a6-4cfc-bc46-90bc68f6d60c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:57.462741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-63d5e865-89a6-4cfc-bc46-90bc68f6d60c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.307282 Oct 06 12:22:57.483415 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 53/97] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:57 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:57.684580 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e5c5776e-8831-4a35-8698-b9dd6a404fa2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:57.685286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e5c5776e-8831-4a35-8698-b9dd6a404fa2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:57.691786 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e5c5776e-8831-4a35-8698-b9dd6a404fa2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:57.692563 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e5c5776e-8831-4a35-8698-b9dd6a404fa2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:57.693094 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e5c5776e-8831-4a35-8698-b9dd6a404fa2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:57.694051 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e5c5776e-8831-4a35-8698-b9dd6a404fa2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:57.694576 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e5c5776e-8831-4a35-8698-b9dd6a404fa2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:57.695206 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e5c5776e-8831-4a35-8698-b9dd6a404fa2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:57.859125 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e5c5776e-8831-4a35-8698-b9dd6a404fa2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:57.866787 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e5c5776e-8831-4a35-8698-b9dd6a404fa2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.185948 Oct 06 12:22:57.867351 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 45/98] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:57 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:57.941426 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b6274146-bc49-43fa-829e-73319c34d477 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:57.941426 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b6274146-bc49-43fa-829e-73319c34d477 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:57.946396 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6274146-bc49-43fa-829e-73319c34d477 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:57.947485 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6274146-bc49-43fa-829e-73319c34d477 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:57.948025 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6274146-bc49-43fa-829e-73319c34d477 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:57.949340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6274146-bc49-43fa-829e-73319c34d477 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:57.949866 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6274146-bc49-43fa-829e-73319c34d477 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:57.950360 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6274146-bc49-43fa-829e-73319c34d477 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:58.118957 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b6274146-bc49-43fa-829e-73319c34d477 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:58.128196 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b6274146-bc49-43fa-829e-73319c34d477 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.193776 Oct 06 12:22:58.129183 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 54/99] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:57 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:58.491173 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ad95a54e-e704-4c26-99e0-a9befa5a8c10 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:58.492567 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ad95a54e-e704-4c26-99e0-a9befa5a8c10 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:58.499105 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ad95a54e-e704-4c26-99e0-a9befa5a8c10 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:58.499904 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ad95a54e-e704-4c26-99e0-a9befa5a8c10 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:58.500563 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ad95a54e-e704-4c26-99e0-a9befa5a8c10 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:58.501506 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ad95a54e-e704-4c26-99e0-a9befa5a8c10 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:58.502926 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ad95a54e-e704-4c26-99e0-a9befa5a8c10 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:58.503607 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ad95a54e-e704-4c26-99e0-a9befa5a8c10 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:58.685705 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ad95a54e-e704-4c26-99e0-a9befa5a8c10 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:58.694094 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ad95a54e-e704-4c26-99e0-a9befa5a8c10 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.208119 Oct 06 12:22:58.695185 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 46/100] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:58 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:58.889972 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ea705e78-d48e-457e-a2c7-eae0fac9fb21 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:58.890574 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ea705e78-d48e-457e-a2c7-eae0fac9fb21 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:58.897265 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ea705e78-d48e-457e-a2c7-eae0fac9fb21 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:58.897785 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ea705e78-d48e-457e-a2c7-eae0fac9fb21 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:58.898291 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ea705e78-d48e-457e-a2c7-eae0fac9fb21 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:58.899071 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ea705e78-d48e-457e-a2c7-eae0fac9fb21 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:58.899576 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ea705e78-d48e-457e-a2c7-eae0fac9fb21 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:58.900003 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ea705e78-d48e-457e-a2c7-eae0fac9fb21 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:59.123183 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ea705e78-d48e-457e-a2c7-eae0fac9fb21 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:59.132481 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ea705e78-d48e-457e-a2c7-eae0fac9fb21 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.246897 Oct 06 12:22:59.133064 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 55/101] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:58 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:59.153508 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-66d08c1c-769a-4c57-9d52-f90c7fe2f2b0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:59.154129 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-66d08c1c-769a-4c57-9d52-f90c7fe2f2b0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:59.160319 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66d08c1c-769a-4c57-9d52-f90c7fe2f2b0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:59.161039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66d08c1c-769a-4c57-9d52-f90c7fe2f2b0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:59.161551 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66d08c1c-769a-4c57-9d52-f90c7fe2f2b0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:59.162402 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66d08c1c-769a-4c57-9d52-f90c7fe2f2b0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:59.162920 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66d08c1c-769a-4c57-9d52-f90c7fe2f2b0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:59.163557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66d08c1c-769a-4c57-9d52-f90c7fe2f2b0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:59.168536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=100 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:59.337852 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-66d08c1c-769a-4c57-9d52-f90c7fe2f2b0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:59.351889 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-66d08c1c-769a-4c57-9d52-f90c7fe2f2b0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.203060 Oct 06 12:22:59.352556 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 47/102] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:59 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:22:59.718557 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f796ef14-9fb2-4993-b0f4-a27bb1afa800 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:22:59.719174 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f796ef14-9fb2-4993-b0f4-a27bb1afa800 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:22:59.735499 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f796ef14-9fb2-4993-b0f4-a27bb1afa800 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:59.736036 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f796ef14-9fb2-4993-b0f4-a27bb1afa800 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:59.736489 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f796ef14-9fb2-4993-b0f4-a27bb1afa800 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:59.741905 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f796ef14-9fb2-4993-b0f4-a27bb1afa800 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:22:59.742467 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f796ef14-9fb2-4993-b0f4-a27bb1afa800 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:22:59.742922 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f796ef14-9fb2-4993-b0f4-a27bb1afa800 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:22:59.951426 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f796ef14-9fb2-4993-b0f4-a27bb1afa800 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:22:59.961058 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f796ef14-9fb2-4993-b0f4-a27bb1afa800 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.246958 Oct 06 12:22:59.961947 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 56/103] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:22:59 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:00.164011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ba717545-9454-47d2-a591-9653df8d1cf8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:00.166284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ba717545-9454-47d2-a591-9653df8d1cf8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:00.175689 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ba717545-9454-47d2-a591-9653df8d1cf8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:00.177000 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ba717545-9454-47d2-a591-9653df8d1cf8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:00.177624 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ba717545-9454-47d2-a591-9653df8d1cf8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:00.178746 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ba717545-9454-47d2-a591-9653df8d1cf8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:00.179771 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ba717545-9454-47d2-a591-9653df8d1cf8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:00.180674 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ba717545-9454-47d2-a591-9653df8d1cf8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:00.339477 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ba717545-9454-47d2-a591-9653df8d1cf8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:00.348472 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ba717545-9454-47d2-a591-9653df8d1cf8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.192606 Oct 06 12:23:00.349142 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 48/104] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:00 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:00.375947 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1ec351af-2a1a-47bd-b4a0-38ab4820a2f0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:00.376659 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-1ec351af-2a1a-47bd-b4a0-38ab4820a2f0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:00.389900 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1ec351af-2a1a-47bd-b4a0-38ab4820a2f0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:00.390979 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1ec351af-2a1a-47bd-b4a0-38ab4820a2f0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:00.391660 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1ec351af-2a1a-47bd-b4a0-38ab4820a2f0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:00.392682 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1ec351af-2a1a-47bd-b4a0-38ab4820a2f0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:00.393216 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1ec351af-2a1a-47bd-b4a0-38ab4820a2f0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:00.393702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1ec351af-2a1a-47bd-b4a0-38ab4820a2f0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:00.422159 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=100 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:00.555475 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-1ec351af-2a1a-47bd-b4a0-38ab4820a2f0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:00.565801 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-1ec351af-2a1a-47bd-b4a0-38ab4820a2f0 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.193494 Oct 06 12:23:00.566724 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 57/105] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:00 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:00.989773 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-00f9a41d-5ef5-4035-b24b-38661aa91e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:00.990382 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-00f9a41d-5ef5-4035-b24b-38661aa91e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:00.996900 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-00f9a41d-5ef5-4035-b24b-38661aa91e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:00.997715 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-00f9a41d-5ef5-4035-b24b-38661aa91e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:00.998370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-00f9a41d-5ef5-4035-b24b-38661aa91e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:00.999621 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-00f9a41d-5ef5-4035-b24b-38661aa91e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:01.000258 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-00f9a41d-5ef5-4035-b24b-38661aa91e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:01.000910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-00f9a41d-5ef5-4035-b24b-38661aa91e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:01.372859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-53759fb1-aae6-4d63-b522-361898c18d26 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:01.373532 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-53759fb1-aae6-4d63-b522-361898c18d26 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:01.379715 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53759fb1-aae6-4d63-b522-361898c18d26 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:01.380310 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53759fb1-aae6-4d63-b522-361898c18d26 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:01.380622 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53759fb1-aae6-4d63-b522-361898c18d26 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:01.381315 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53759fb1-aae6-4d63-b522-361898c18d26 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:01.381768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53759fb1-aae6-4d63-b522-361898c18d26 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:01.382227 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53759fb1-aae6-4d63-b522-361898c18d26 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:01.397652 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-00f9a41d-5ef5-4035-b24b-38661aa91e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:01.412021 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-00f9a41d-5ef5-4035-b24b-38661aa91e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.425341 Oct 06 12:23:01.412899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 49/106] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:00 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:01.574526 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-53759fb1-aae6-4d63-b522-361898c18d26 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:01.585779 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-53759fb1-aae6-4d63-b522-361898c18d26 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.218143 Oct 06 12:23:01.586362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 58/107] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:01 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:01.592110 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f9d93acd-b891-4b65-82da-9a1dd900bd2f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:01.593396 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f9d93acd-b891-4b65-82da-9a1dd900bd2f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:01.601373 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f9d93acd-b891-4b65-82da-9a1dd900bd2f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:01.602894 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f9d93acd-b891-4b65-82da-9a1dd900bd2f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:01.603558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f9d93acd-b891-4b65-82da-9a1dd900bd2f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:01.604595 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f9d93acd-b891-4b65-82da-9a1dd900bd2f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:01.605312 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f9d93acd-b891-4b65-82da-9a1dd900bd2f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:01.606072 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f9d93acd-b891-4b65-82da-9a1dd900bd2f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:01.804438 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f9d93acd-b891-4b65-82da-9a1dd900bd2f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:01.811923 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f9d93acd-b891-4b65-82da-9a1dd900bd2f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.225940 Oct 06 12:23:01.812683 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 50/108] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:01 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:02.435725 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-846583ff-54e1-4bcb-bd11-73a60d295af2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:02.436401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-846583ff-54e1-4bcb-bd11-73a60d295af2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:02.442430 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-846583ff-54e1-4bcb-bd11-73a60d295af2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:02.442918 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-846583ff-54e1-4bcb-bd11-73a60d295af2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:02.443358 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-846583ff-54e1-4bcb-bd11-73a60d295af2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:02.444081 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-846583ff-54e1-4bcb-bd11-73a60d295af2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:02.444541 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-846583ff-54e1-4bcb-bd11-73a60d295af2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:02.444973 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-846583ff-54e1-4bcb-bd11-73a60d295af2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:02.571946 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-846583ff-54e1-4bcb-bd11-73a60d295af2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:02.580119 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-846583ff-54e1-4bcb-bd11-73a60d295af2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.148414 Oct 06 12:23:02.580683 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 59/109] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:02 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:02.613597 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4ae10350-fb28-4e30-9374-2f9ff858274c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:02.614197 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4ae10350-fb28-4e30-9374-2f9ff858274c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:02.620562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ae10350-fb28-4e30-9374-2f9ff858274c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:02.621037 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ae10350-fb28-4e30-9374-2f9ff858274c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:02.621470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ae10350-fb28-4e30-9374-2f9ff858274c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:02.622149 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ae10350-fb28-4e30-9374-2f9ff858274c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:02.622596 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ae10350-fb28-4e30-9374-2f9ff858274c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:02.623010 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ae10350-fb28-4e30-9374-2f9ff858274c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:02.836235 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-af5e8904-2bc1-4293-bac0-808f8496abd7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:02.836843 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-af5e8904-2bc1-4293-bac0-808f8496abd7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:02.844447 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-af5e8904-2bc1-4293-bac0-808f8496abd7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:02.844944 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-af5e8904-2bc1-4293-bac0-808f8496abd7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:02.845377 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-af5e8904-2bc1-4293-bac0-808f8496abd7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:02.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-af5e8904-2bc1-4293-bac0-808f8496abd7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:02.846854 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-af5e8904-2bc1-4293-bac0-808f8496abd7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:02.848127 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-af5e8904-2bc1-4293-bac0-808f8496abd7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:02.901526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4ae10350-fb28-4e30-9374-2f9ff858274c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:02.909154 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4ae10350-fb28-4e30-9374-2f9ff858274c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.299418 Oct 06 12:23:02.924005 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 51/110] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:02 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:03.236990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-af5e8904-2bc1-4293-bac0-808f8496abd7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:03.258978 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-af5e8904-2bc1-4293-bac0-808f8496abd7 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.426987 Oct 06 12:23:03.259927 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 60/111] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:02 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:03.603162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2c4e8ebc-c3dd-4e43-9280-309f8659297f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:03.603805 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2c4e8ebc-c3dd-4e43-9280-309f8659297f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:03.609767 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c4e8ebc-c3dd-4e43-9280-309f8659297f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:03.610282 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c4e8ebc-c3dd-4e43-9280-309f8659297f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:03.610713 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c4e8ebc-c3dd-4e43-9280-309f8659297f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:03.611396 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c4e8ebc-c3dd-4e43-9280-309f8659297f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:03.611874 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c4e8ebc-c3dd-4e43-9280-309f8659297f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:03.612294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c4e8ebc-c3dd-4e43-9280-309f8659297f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:03.813431 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2c4e8ebc-c3dd-4e43-9280-309f8659297f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:03.820977 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2c4e8ebc-c3dd-4e43-9280-309f8659297f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.221782 Oct 06 12:23:03.821605 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 52/112] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:03 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:03.865497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-4dfb5893-4b01-45b0-a658-53e958ae23f4 req-35bb3ba7-b9d7-481c-967a-50a4ef9b7fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7c26e82-69b3-4ffa-97e2-7ca36b941c1f", "tag": "2f5ac9b9-0c5c-4565-96ae-3de71a11dddd"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:23:03.879049 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-4dfb5893-4b01-45b0-a658-53e958ae23f4 req-35bb3ba7-b9d7-481c-967a-50a4ef9b7fe6 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:03.879584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-4dfb5893-4b01-45b0-a658-53e958ae23f4 req-35bb3ba7-b9d7-481c-967a-50a4ef9b7fe6 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:03.880184 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-4dfb5893-4b01-45b0-a658-53e958ae23f4 req-35bb3ba7-b9d7-481c-967a-50a4ef9b7fe6 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:03.892653 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-4dfb5893-4b01-45b0-a658-53e958ae23f4 req-35bb3ba7-b9d7-481c-967a-50a4ef9b7fe6 service nova] Creating event network-changed:2f5ac9b9-0c5c-4565-96ae-3de71a11dddd for instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f on hv-cinder-85604 Oct 06 12:23:03.897579 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-4dfb5893-4b01-45b0-a658-53e958ae23f4 req-35bb3ba7-b9d7-481c-967a-50a4ef9b7fe6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038672 Oct 06 12:23:03.898180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 61/113] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:23:03.932617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-1a804c5f-f092-47b6-aec8-753d185d828d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:03.933232 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-1a804c5f-f092-47b6-aec8-753d185d828d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:03.939495 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1a804c5f-f092-47b6-aec8-753d185d828d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:03.939938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1a804c5f-f092-47b6-aec8-753d185d828d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:03.940375 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1a804c5f-f092-47b6-aec8-753d185d828d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:03.941060 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1a804c5f-f092-47b6-aec8-753d185d828d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:03.941698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1a804c5f-f092-47b6-aec8-753d185d828d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:03.942125 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1a804c5f-f092-47b6-aec8-753d185d828d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:04.100167 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-1a804c5f-f092-47b6-aec8-753d185d828d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:04.108883 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-1a804c5f-f092-47b6-aec8-753d185d828d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.180079 Oct 06 12:23:04.109746 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 53/114] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:03 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:04.284384 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d641e2d4-ed9d-4ed3-a0ef-18a42f02b677 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:04.285600 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d641e2d4-ed9d-4ed3-a0ef-18a42f02b677 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:04.293029 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d641e2d4-ed9d-4ed3-a0ef-18a42f02b677 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:04.293618 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d641e2d4-ed9d-4ed3-a0ef-18a42f02b677 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:04.294074 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d641e2d4-ed9d-4ed3-a0ef-18a42f02b677 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:04.294759 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d641e2d4-ed9d-4ed3-a0ef-18a42f02b677 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:04.295214 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d641e2d4-ed9d-4ed3-a0ef-18a42f02b677 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:04.295784 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d641e2d4-ed9d-4ed3-a0ef-18a42f02b677 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:04.451421 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d641e2d4-ed9d-4ed3-a0ef-18a42f02b677 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:04.459139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d641e2d4-ed9d-4ed3-a0ef-18a42f02b677 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.179582 Oct 06 12:23:04.459755 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 62/115] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:04 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:04.850571 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-19d9242d-ebbe-4d1d-98aa-436e56c308df tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:04.851200 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-19d9242d-ebbe-4d1d-98aa-436e56c308df tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:04.857459 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-19d9242d-ebbe-4d1d-98aa-436e56c308df tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:04.857932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-19d9242d-ebbe-4d1d-98aa-436e56c308df tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:04.858353 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-19d9242d-ebbe-4d1d-98aa-436e56c308df tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:04.859030 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-19d9242d-ebbe-4d1d-98aa-436e56c308df tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:04.860771 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-19d9242d-ebbe-4d1d-98aa-436e56c308df tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:04.861639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-19d9242d-ebbe-4d1d-98aa-436e56c308df tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:04.958791 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:05.011103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-19d9242d-ebbe-4d1d-98aa-436e56c308df tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:05.019351 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-19d9242d-ebbe-4d1d-98aa-436e56c308df tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.174064 Oct 06 12:23:05.019941 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 54/116] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:04 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:05.022452 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-e9c52bea-d7d7-4211-89e2-2f8f7b4dc722 req-238abfd9-c206-40e9-932c-51bde1170867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bdd2944-b97f-40e0-a1cb-915cea031265", "name": "network-vif-plugged", "status": "completed", "tag": "9e7b0b39-c340-4a59-8b3a-a243b300266f"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:23:05.042871 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-e9c52bea-d7d7-4211-89e2-2f8f7b4dc722 req-238abfd9-c206-40e9-932c-51bde1170867 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:05.043541 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-e9c52bea-d7d7-4211-89e2-2f8f7b4dc722 req-238abfd9-c206-40e9-932c-51bde1170867 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:05.044170 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-e9c52bea-d7d7-4211-89e2-2f8f7b4dc722 req-238abfd9-c206-40e9-932c-51bde1170867 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:05.056237 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-e9c52bea-d7d7-4211-89e2-2f8f7b4dc722 req-238abfd9-c206-40e9-932c-51bde1170867 service nova] Creating event network-vif-plugged:9e7b0b39-c340-4a59-8b3a-a243b300266f for instance 6bdd2944-b97f-40e0-a1cb-915cea031265 on hv-cinder-85604 Oct 06 12:23:05.063902 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-e9c52bea-d7d7-4211-89e2-2f8f7b4dc722 req-238abfd9-c206-40e9-932c-51bde1170867 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109818 Oct 06 12:23:05.064703 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 63/117] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:23:05.132503 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-80dce243-6038-49ed-a025-326204bb6e4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:05.133114 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-80dce243-6038-49ed-a025-326204bb6e4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:05.139147 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-80dce243-6038-49ed-a025-326204bb6e4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:05.139669 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-80dce243-6038-49ed-a025-326204bb6e4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:05.140106 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-80dce243-6038-49ed-a025-326204bb6e4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:05.140791 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-80dce243-6038-49ed-a025-326204bb6e4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:05.141260 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-80dce243-6038-49ed-a025-326204bb6e4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:05.141698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-80dce243-6038-49ed-a025-326204bb6e4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:05.278437 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-80dce243-6038-49ed-a025-326204bb6e4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:05.286362 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-80dce243-6038-49ed-a025-326204bb6e4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.157828 Oct 06 12:23:05.286934 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 55/118] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:05 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:05.484783 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a1740f6f-8113-476a-8c5e-842283737036 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:05.485585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a1740f6f-8113-476a-8c5e-842283737036 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:05.492053 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a1740f6f-8113-476a-8c5e-842283737036 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:05.492622 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a1740f6f-8113-476a-8c5e-842283737036 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:05.493126 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a1740f6f-8113-476a-8c5e-842283737036 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:05.493830 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a1740f6f-8113-476a-8c5e-842283737036 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:05.494288 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a1740f6f-8113-476a-8c5e-842283737036 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:05.494721 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a1740f6f-8113-476a-8c5e-842283737036 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:05.622874 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a1740f6f-8113-476a-8c5e-842283737036 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:05.630631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a1740f6f-8113-476a-8c5e-842283737036 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.150177 Oct 06 12:23:05.631224 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 64/119] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:05 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:06.044200 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d705eb5f-09e6-42a8-b64a-8cde2d55f90c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:06.044812 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d705eb5f-09e6-42a8-b64a-8cde2d55f90c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:06.050764 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d705eb5f-09e6-42a8-b64a-8cde2d55f90c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:06.051245 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d705eb5f-09e6-42a8-b64a-8cde2d55f90c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:06.051775 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d705eb5f-09e6-42a8-b64a-8cde2d55f90c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:06.052452 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d705eb5f-09e6-42a8-b64a-8cde2d55f90c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:06.052898 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d705eb5f-09e6-42a8-b64a-8cde2d55f90c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:06.053317 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d705eb5f-09e6-42a8-b64a-8cde2d55f90c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:06.183530 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d705eb5f-09e6-42a8-b64a-8cde2d55f90c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:06.191374 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d705eb5f-09e6-42a8-b64a-8cde2d55f90c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.151031 Oct 06 12:23:06.191963 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 56/120] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:06 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:06.309487 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d6e55ebf-fcde-4bb8-8b76-8a0609afb999 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:06.310065 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d6e55ebf-fcde-4bb8-8b76-8a0609afb999 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:06.315874 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6e55ebf-fcde-4bb8-8b76-8a0609afb999 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:06.316355 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6e55ebf-fcde-4bb8-8b76-8a0609afb999 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:06.316785 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6e55ebf-fcde-4bb8-8b76-8a0609afb999 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:06.317464 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6e55ebf-fcde-4bb8-8b76-8a0609afb999 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:06.317918 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6e55ebf-fcde-4bb8-8b76-8a0609afb999 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:06.318338 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6e55ebf-fcde-4bb8-8b76-8a0609afb999 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:06.442589 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d6e55ebf-fcde-4bb8-8b76-8a0609afb999 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:06.450664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d6e55ebf-fcde-4bb8-8b76-8a0609afb999 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.145675 Oct 06 12:23:06.451230 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 65/121] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:06 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:06.653948 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4896faff-1505-4cb3-8dd5-18858db51a3b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:06.654548 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4896faff-1505-4cb3-8dd5-18858db51a3b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:06.660615 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4896faff-1505-4cb3-8dd5-18858db51a3b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:06.661091 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4896faff-1505-4cb3-8dd5-18858db51a3b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:06.661520 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4896faff-1505-4cb3-8dd5-18858db51a3b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:06.662220 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4896faff-1505-4cb3-8dd5-18858db51a3b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:06.662664 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4896faff-1505-4cb3-8dd5-18858db51a3b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:06.663099 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4896faff-1505-4cb3-8dd5-18858db51a3b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:06.785381 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4896faff-1505-4cb3-8dd5-18858db51a3b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:06.793531 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4896faff-1505-4cb3-8dd5-18858db51a3b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.143880 Oct 06 12:23:06.794104 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 57/122] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:06 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:07.213129 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-71412a43-c4e5-452e-a008-c5a2a0f5a75a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:07.214284 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-71412a43-c4e5-452e-a008-c5a2a0f5a75a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:07.220115 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-71412a43-c4e5-452e-a008-c5a2a0f5a75a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:07.220593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-71412a43-c4e5-452e-a008-c5a2a0f5a75a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:07.221026 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-71412a43-c4e5-452e-a008-c5a2a0f5a75a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:07.221781 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-71412a43-c4e5-452e-a008-c5a2a0f5a75a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:07.222158 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-71412a43-c4e5-452e-a008-c5a2a0f5a75a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:07.222578 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-71412a43-c4e5-452e-a008-c5a2a0f5a75a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:07.351369 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-71412a43-c4e5-452e-a008-c5a2a0f5a75a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:07.358980 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-71412a43-c4e5-452e-a008-c5a2a0f5a75a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.149631 Oct 06 12:23:07.359569 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 66/123] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:07 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:07.473270 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3e3ca891-2ac1-4baf-97b6-ef7cb9e3deac tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:07.473791 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3e3ca891-2ac1-4baf-97b6-ef7cb9e3deac tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:07.480196 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3e3ca891-2ac1-4baf-97b6-ef7cb9e3deac tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:07.480702 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3e3ca891-2ac1-4baf-97b6-ef7cb9e3deac tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:07.481130 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3e3ca891-2ac1-4baf-97b6-ef7cb9e3deac tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:07.481807 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3e3ca891-2ac1-4baf-97b6-ef7cb9e3deac tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:07.482246 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3e3ca891-2ac1-4baf-97b6-ef7cb9e3deac tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:07.482657 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3e3ca891-2ac1-4baf-97b6-ef7cb9e3deac tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:07.606607 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3e3ca891-2ac1-4baf-97b6-ef7cb9e3deac tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:07.614114 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3e3ca891-2ac1-4baf-97b6-ef7cb9e3deac tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.144766 Oct 06 12:23:07.614672 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 58/124] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:07 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:07.816503 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d01f1390-3019-49c8-9a9f-bb27b5d6a4a6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:07.817039 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d01f1390-3019-49c8-9a9f-bb27b5d6a4a6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:07.824203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d01f1390-3019-49c8-9a9f-bb27b5d6a4a6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:07.824691 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d01f1390-3019-49c8-9a9f-bb27b5d6a4a6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:07.825127 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d01f1390-3019-49c8-9a9f-bb27b5d6a4a6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:07.825841 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d01f1390-3019-49c8-9a9f-bb27b5d6a4a6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:07.826299 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d01f1390-3019-49c8-9a9f-bb27b5d6a4a6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:07.826727 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d01f1390-3019-49c8-9a9f-bb27b5d6a4a6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:07.959948 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d01f1390-3019-49c8-9a9f-bb27b5d6a4a6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:07.968086 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d01f1390-3019-49c8-9a9f-bb27b5d6a4a6 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.155178 Oct 06 12:23:07.969938 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 67/125] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:07 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:08.382098 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a944dc1d-fba5-4446-a507-81c5865e6d90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:08.382615 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a944dc1d-fba5-4446-a507-81c5865e6d90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:08.388986 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a944dc1d-fba5-4446-a507-81c5865e6d90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:08.389608 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a944dc1d-fba5-4446-a507-81c5865e6d90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:08.390056 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a944dc1d-fba5-4446-a507-81c5865e6d90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:08.391111 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a944dc1d-fba5-4446-a507-81c5865e6d90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:08.391205 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a944dc1d-fba5-4446-a507-81c5865e6d90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:08.391666 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a944dc1d-fba5-4446-a507-81c5865e6d90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:08.518523 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a944dc1d-fba5-4446-a507-81c5865e6d90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:08.526374 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a944dc1d-fba5-4446-a507-81c5865e6d90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.148141 Oct 06 12:23:08.526952 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 59/126] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:08 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:08.637952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9b06c178-3a35-4930-acfe-ce40e72265dd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:08.638514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9b06c178-3a35-4930-acfe-ce40e72265dd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:08.644420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b06c178-3a35-4930-acfe-ce40e72265dd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:08.644905 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b06c178-3a35-4930-acfe-ce40e72265dd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:08.645340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b06c178-3a35-4930-acfe-ce40e72265dd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:08.646027 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b06c178-3a35-4930-acfe-ce40e72265dd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:08.646485 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b06c178-3a35-4930-acfe-ce40e72265dd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:08.646910 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b06c178-3a35-4930-acfe-ce40e72265dd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:08.777929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9b06c178-3a35-4930-acfe-ce40e72265dd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:08.785867 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9b06c178-3a35-4930-acfe-ce40e72265dd tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.152388 Oct 06 12:23:08.786427 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 68/127] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:08 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:08.992250 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-29ce072e-7859-4164-8c24-8e84a7740ec1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:08.992774 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-29ce072e-7859-4164-8c24-8e84a7740ec1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:08.999370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-29ce072e-7859-4164-8c24-8e84a7740ec1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:08.999886 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-29ce072e-7859-4164-8c24-8e84a7740ec1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:09.000328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-29ce072e-7859-4164-8c24-8e84a7740ec1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:09.001010 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-29ce072e-7859-4164-8c24-8e84a7740ec1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:09.001460 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-29ce072e-7859-4164-8c24-8e84a7740ec1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:09.001880 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-29ce072e-7859-4164-8c24-8e84a7740ec1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:09.125486 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-29ce072e-7859-4164-8c24-8e84a7740ec1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:09.133114 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-29ce072e-7859-4164-8c24-8e84a7740ec1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.144913 Oct 06 12:23:09.133674 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 60/128] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:08 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:09.549784 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b16bde59-07ba-4be8-abf2-d953a405c285 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:09.550396 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b16bde59-07ba-4be8-abf2-d953a405c285 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:09.556200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b16bde59-07ba-4be8-abf2-d953a405c285 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:09.556677 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b16bde59-07ba-4be8-abf2-d953a405c285 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:09.557108 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b16bde59-07ba-4be8-abf2-d953a405c285 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:09.557786 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b16bde59-07ba-4be8-abf2-d953a405c285 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:09.558231 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b16bde59-07ba-4be8-abf2-d953a405c285 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:09.558647 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b16bde59-07ba-4be8-abf2-d953a405c285 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:09.684598 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b16bde59-07ba-4be8-abf2-d953a405c285 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:09.692163 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b16bde59-07ba-4be8-abf2-d953a405c285 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.146127 Oct 06 12:23:09.692726 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 69/129] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:09 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:09.808380 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9aa14eff-4ebc-4d06-9fcb-9bee79ce6909 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:09.808921 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9aa14eff-4ebc-4d06-9fcb-9bee79ce6909 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:09.814832 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9aa14eff-4ebc-4d06-9fcb-9bee79ce6909 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:09.815323 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9aa14eff-4ebc-4d06-9fcb-9bee79ce6909 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:09.815786 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9aa14eff-4ebc-4d06-9fcb-9bee79ce6909 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:09.816466 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9aa14eff-4ebc-4d06-9fcb-9bee79ce6909 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:09.816913 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9aa14eff-4ebc-4d06-9fcb-9bee79ce6909 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:09.817332 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9aa14eff-4ebc-4d06-9fcb-9bee79ce6909 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:10.087887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9aa14eff-4ebc-4d06-9fcb-9bee79ce6909 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:10.096029 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9aa14eff-4ebc-4d06-9fcb-9bee79ce6909 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.291507 Oct 06 12:23:10.096600 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 61/130] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:09 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:10.155125 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7b7db160-5474-4a60-8595-971253021167 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:10.155765 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7b7db160-5474-4a60-8595-971253021167 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:10.161911 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7b7db160-5474-4a60-8595-971253021167 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:10.162382 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7b7db160-5474-4a60-8595-971253021167 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:10.162806 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7b7db160-5474-4a60-8595-971253021167 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:10.163475 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7b7db160-5474-4a60-8595-971253021167 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:10.163944 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7b7db160-5474-4a60-8595-971253021167 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:10.164365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7b7db160-5474-4a60-8595-971253021167 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:10.293371 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7b7db160-5474-4a60-8595-971253021167 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:10.300978 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7b7db160-5474-4a60-8595-971253021167 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.149715 Oct 06 12:23:10.301545 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 70/131] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:10 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:10.715123 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-168ff545-2f0f-4f26-ab0f-d157d0d8bdfe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:10.715776 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-168ff545-2f0f-4f26-ab0f-d157d0d8bdfe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:10.721619 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-168ff545-2f0f-4f26-ab0f-d157d0d8bdfe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:10.722095 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-168ff545-2f0f-4f26-ab0f-d157d0d8bdfe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:10.722515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-168ff545-2f0f-4f26-ab0f-d157d0d8bdfe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:10.723184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-168ff545-2f0f-4f26-ab0f-d157d0d8bdfe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:10.723651 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-168ff545-2f0f-4f26-ab0f-d157d0d8bdfe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:10.724064 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-168ff545-2f0f-4f26-ab0f-d157d0d8bdfe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:10.854284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-168ff545-2f0f-4f26-ab0f-d157d0d8bdfe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:10.861879 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-168ff545-2f0f-4f26-ab0f-d157d0d8bdfe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.151558 Oct 06 12:23:10.862449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 62/132] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:10 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:11.120088 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c4732381-c42a-4422-877a-ef2295482081 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:11.120782 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c4732381-c42a-4422-877a-ef2295482081 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:11.127118 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c4732381-c42a-4422-877a-ef2295482081 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:11.127787 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c4732381-c42a-4422-877a-ef2295482081 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:11.128273 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c4732381-c42a-4422-877a-ef2295482081 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:11.129046 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c4732381-c42a-4422-877a-ef2295482081 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:11.129497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c4732381-c42a-4422-877a-ef2295482081 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:11.129917 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c4732381-c42a-4422-877a-ef2295482081 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:11.258913 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c4732381-c42a-4422-877a-ef2295482081 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:11.266982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c4732381-c42a-4422-877a-ef2295482081 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.151849 Oct 06 12:23:11.267571 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 71/133] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:11 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:11.324844 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8f1209c1-4392-46e5-b889-b465d9bd11ec tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:11.325486 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8f1209c1-4392-46e5-b889-b465d9bd11ec tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:11.331744 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8f1209c1-4392-46e5-b889-b465d9bd11ec tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:11.332233 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8f1209c1-4392-46e5-b889-b465d9bd11ec tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:11.332660 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8f1209c1-4392-46e5-b889-b465d9bd11ec tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:11.333349 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8f1209c1-4392-46e5-b889-b465d9bd11ec tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:11.334005 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8f1209c1-4392-46e5-b889-b465d9bd11ec tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:11.334582 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8f1209c1-4392-46e5-b889-b465d9bd11ec tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:11.485369 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8f1209c1-4392-46e5-b889-b465d9bd11ec tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:11.488752 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=100 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:11.494893 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8f1209c1-4392-46e5-b889-b465d9bd11ec tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.174505 Oct 06 12:23:11.495468 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 63/134] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:11 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:11.884846 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-765d314a-853f-499c-b5a3-4bbce7dd17bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:11.886203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-765d314a-853f-499c-b5a3-4bbce7dd17bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:11.892396 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-765d314a-853f-499c-b5a3-4bbce7dd17bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:11.893056 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-765d314a-853f-499c-b5a3-4bbce7dd17bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:11.893498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-765d314a-853f-499c-b5a3-4bbce7dd17bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:11.894196 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-765d314a-853f-499c-b5a3-4bbce7dd17bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:11.894670 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-765d314a-853f-499c-b5a3-4bbce7dd17bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:11.895082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-765d314a-853f-499c-b5a3-4bbce7dd17bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:12.017842 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-765d314a-853f-499c-b5a3-4bbce7dd17bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:12.025338 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-765d314a-853f-499c-b5a3-4bbce7dd17bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.144320 Oct 06 12:23:12.025959 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 72/135] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:11 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:12.290095 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2df3f41d-1d7e-4a50-ba43-a784a7e03953 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:12.290695 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2df3f41d-1d7e-4a50-ba43-a784a7e03953 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:12.298014 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2df3f41d-1d7e-4a50-ba43-a784a7e03953 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:12.299331 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2df3f41d-1d7e-4a50-ba43-a784a7e03953 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:12.299795 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2df3f41d-1d7e-4a50-ba43-a784a7e03953 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:12.300468 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2df3f41d-1d7e-4a50-ba43-a784a7e03953 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:12.300914 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2df3f41d-1d7e-4a50-ba43-a784a7e03953 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:12.301331 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2df3f41d-1d7e-4a50-ba43-a784a7e03953 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:12.438979 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2df3f41d-1d7e-4a50-ba43-a784a7e03953 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:12.446523 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2df3f41d-1d7e-4a50-ba43-a784a7e03953 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.160586 Oct 06 12:23:12.447076 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 64/136] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:12 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:12.517474 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c3ff03a2-6a9c-40fe-a198-75ebced46ec9 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:12.518027 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c3ff03a2-6a9c-40fe-a198-75ebced46ec9 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:12.524118 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3ff03a2-6a9c-40fe-a198-75ebced46ec9 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:12.524606 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3ff03a2-6a9c-40fe-a198-75ebced46ec9 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:12.525046 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3ff03a2-6a9c-40fe-a198-75ebced46ec9 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:12.526228 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3ff03a2-6a9c-40fe-a198-75ebced46ec9 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:12.526685 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3ff03a2-6a9c-40fe-a198-75ebced46ec9 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:12.527113 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3ff03a2-6a9c-40fe-a198-75ebced46ec9 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:12.667096 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c3ff03a2-6a9c-40fe-a198-75ebced46ec9 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:12.675259 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c3ff03a2-6a9c-40fe-a198-75ebced46ec9 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.161551 Oct 06 12:23:12.675862 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 73/137] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:12 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:13.048141 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-23a1887e-77b6-42a9-8c86-965743c589f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:13.048766 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-23a1887e-77b6-42a9-8c86-965743c589f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:13.054695 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23a1887e-77b6-42a9-8c86-965743c589f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:13.055172 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23a1887e-77b6-42a9-8c86-965743c589f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:13.055693 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23a1887e-77b6-42a9-8c86-965743c589f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:13.056365 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23a1887e-77b6-42a9-8c86-965743c589f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:13.056803 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23a1887e-77b6-42a9-8c86-965743c589f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:13.057214 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23a1887e-77b6-42a9-8c86-965743c589f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:13.182370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-23a1887e-77b6-42a9-8c86-965743c589f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:13.189760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-23a1887e-77b6-42a9-8c86-965743c589f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.145497 Oct 06 12:23:13.190319 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 65/138] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:13 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:13.469678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-74a73cd7-234c-4fd8-92dc-aa4509441385 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:13.470293 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-74a73cd7-234c-4fd8-92dc-aa4509441385 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:13.476206 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-74a73cd7-234c-4fd8-92dc-aa4509441385 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:13.476689 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-74a73cd7-234c-4fd8-92dc-aa4509441385 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:13.477122 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-74a73cd7-234c-4fd8-92dc-aa4509441385 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:13.477807 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-74a73cd7-234c-4fd8-92dc-aa4509441385 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:13.478260 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-74a73cd7-234c-4fd8-92dc-aa4509441385 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:13.479278 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-74a73cd7-234c-4fd8-92dc-aa4509441385 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:13.611347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-74a73cd7-234c-4fd8-92dc-aa4509441385 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:13.620454 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-74a73cd7-234c-4fd8-92dc-aa4509441385 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.154593 Oct 06 12:23:13.635733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 74/139] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:13 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:13.698024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ce2deaf5-4781-4ffa-bb03-77c2518df9c1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:13.698617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ce2deaf5-4781-4ffa-bb03-77c2518df9c1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:13.704329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce2deaf5-4781-4ffa-bb03-77c2518df9c1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:13.704802 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce2deaf5-4781-4ffa-bb03-77c2518df9c1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:13.705219 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce2deaf5-4781-4ffa-bb03-77c2518df9c1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:13.705884 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce2deaf5-4781-4ffa-bb03-77c2518df9c1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:13.706321 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce2deaf5-4781-4ffa-bb03-77c2518df9c1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:13.706729 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce2deaf5-4781-4ffa-bb03-77c2518df9c1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:13.836671 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ce2deaf5-4781-4ffa-bb03-77c2518df9c1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:13.844870 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ce2deaf5-4781-4ffa-bb03-77c2518df9c1 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.151157 Oct 06 12:23:13.845436 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 66/140] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:13 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:14.212613 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2d4e6cb7-12c2-43ef-83e9-92504c4037a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:14.213892 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2d4e6cb7-12c2-43ef-83e9-92504c4037a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:14.219722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d4e6cb7-12c2-43ef-83e9-92504c4037a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:14.220196 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d4e6cb7-12c2-43ef-83e9-92504c4037a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:14.220626 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d4e6cb7-12c2-43ef-83e9-92504c4037a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:14.221299 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d4e6cb7-12c2-43ef-83e9-92504c4037a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:14.221747 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d4e6cb7-12c2-43ef-83e9-92504c4037a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:14.222161 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d4e6cb7-12c2-43ef-83e9-92504c4037a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:14.240268 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=100 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:14.358442 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2d4e6cb7-12c2-43ef-83e9-92504c4037a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:14.366022 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2d4e6cb7-12c2-43ef-83e9-92504c4037a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.157207 Oct 06 12:23:14.366592 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 75/141] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:14 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:14.644848 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a7add8ec-1efb-4495-bbbf-8f7565af6c22 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:14.645442 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a7add8ec-1efb-4495-bbbf-8f7565af6c22 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:14.653261 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a7add8ec-1efb-4495-bbbf-8f7565af6c22 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:14.654645 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a7add8ec-1efb-4495-bbbf-8f7565af6c22 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:14.655072 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a7add8ec-1efb-4495-bbbf-8f7565af6c22 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:14.655900 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a7add8ec-1efb-4495-bbbf-8f7565af6c22 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:14.656356 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a7add8ec-1efb-4495-bbbf-8f7565af6c22 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:14.656786 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a7add8ec-1efb-4495-bbbf-8f7565af6c22 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:14.797367 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a7add8ec-1efb-4495-bbbf-8f7565af6c22 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:14.805257 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a7add8ec-1efb-4495-bbbf-8f7565af6c22 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.164606 Oct 06 12:23:14.805975 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 67/142] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:14 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:14.866727 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-18ec2714-37c8-49fe-ad97-db69d64c55fd tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:14.867346 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-18ec2714-37c8-49fe-ad97-db69d64c55fd tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:14.873787 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18ec2714-37c8-49fe-ad97-db69d64c55fd tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:14.874272 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18ec2714-37c8-49fe-ad97-db69d64c55fd tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:14.874710 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18ec2714-37c8-49fe-ad97-db69d64c55fd tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:14.875399 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18ec2714-37c8-49fe-ad97-db69d64c55fd tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:14.875882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18ec2714-37c8-49fe-ad97-db69d64c55fd tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:14.876309 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18ec2714-37c8-49fe-ad97-db69d64c55fd tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:15.000701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-18ec2714-37c8-49fe-ad97-db69d64c55fd tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:15.009135 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-18ec2714-37c8-49fe-ad97-db69d64c55fd tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.145344 Oct 06 12:23:15.009981 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 76/143] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:14 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:15.389584 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d4d185a8-b68d-4d23-9be2-e070ec2b6128 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:15.390223 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d4d185a8-b68d-4d23-9be2-e070ec2b6128 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:15.396270 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d4d185a8-b68d-4d23-9be2-e070ec2b6128 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:15.396745 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d4d185a8-b68d-4d23-9be2-e070ec2b6128 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:15.397176 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d4d185a8-b68d-4d23-9be2-e070ec2b6128 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:15.397849 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d4d185a8-b68d-4d23-9be2-e070ec2b6128 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:15.398294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d4d185a8-b68d-4d23-9be2-e070ec2b6128 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:15.398712 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d4d185a8-b68d-4d23-9be2-e070ec2b6128 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:15.540713 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d4d185a8-b68d-4d23-9be2-e070ec2b6128 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:15.548189 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d4d185a8-b68d-4d23-9be2-e070ec2b6128 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.162974 Oct 06 12:23:15.548748 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 68/144] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:15 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:15.828643 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-784495df-276f-471b-9033-fac39b595ae0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:15.829249 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-784495df-276f-471b-9033-fac39b595ae0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:15.835287 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-784495df-276f-471b-9033-fac39b595ae0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:15.835804 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-784495df-276f-471b-9033-fac39b595ae0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:15.836242 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-784495df-276f-471b-9033-fac39b595ae0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:15.836986 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-784495df-276f-471b-9033-fac39b595ae0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:15.837427 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-784495df-276f-471b-9033-fac39b595ae0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:15.837858 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-784495df-276f-471b-9033-fac39b595ae0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:15.966409 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-784495df-276f-471b-9033-fac39b595ae0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:15.974215 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-784495df-276f-471b-9033-fac39b595ae0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.149969 Oct 06 12:23:15.974788 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 77/145] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:15 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:16.033765 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-76dcd9b9-82c3-40e2-8be8-e4ed113eaa70 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:16.034784 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-76dcd9b9-82c3-40e2-8be8-e4ed113eaa70 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:16.040847 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-76dcd9b9-82c3-40e2-8be8-e4ed113eaa70 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:16.041926 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-76dcd9b9-82c3-40e2-8be8-e4ed113eaa70 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:16.042422 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-76dcd9b9-82c3-40e2-8be8-e4ed113eaa70 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:16.043239 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-76dcd9b9-82c3-40e2-8be8-e4ed113eaa70 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:16.043784 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-76dcd9b9-82c3-40e2-8be8-e4ed113eaa70 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:16.044264 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-76dcd9b9-82c3-40e2-8be8-e4ed113eaa70 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:16.178802 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-76dcd9b9-82c3-40e2-8be8-e4ed113eaa70 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:16.186882 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-76dcd9b9-82c3-40e2-8be8-e4ed113eaa70 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.158568 Oct 06 12:23:16.187438 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 69/146] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:16 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:16.571137 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-323de8a0-520c-4dd3-8670-953c3eac9da4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:16.571782 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-323de8a0-520c-4dd3-8670-953c3eac9da4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:16.577751 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-323de8a0-520c-4dd3-8670-953c3eac9da4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:16.578237 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-323de8a0-520c-4dd3-8670-953c3eac9da4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:16.578674 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-323de8a0-520c-4dd3-8670-953c3eac9da4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:16.579369 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-323de8a0-520c-4dd3-8670-953c3eac9da4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:16.579868 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-323de8a0-520c-4dd3-8670-953c3eac9da4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:16.580301 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-323de8a0-520c-4dd3-8670-953c3eac9da4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:16.708212 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-323de8a0-520c-4dd3-8670-953c3eac9da4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:16.715815 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-323de8a0-520c-4dd3-8670-953c3eac9da4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.148554 Oct 06 12:23:16.716385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 78/147] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:16 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:16.998518 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8fe00f2c-3605-4809-bedc-f547fe889cc4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:16.999459 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8fe00f2c-3605-4809-bedc-f547fe889cc4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:17.005318 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8fe00f2c-3605-4809-bedc-f547fe889cc4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:17.005864 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8fe00f2c-3605-4809-bedc-f547fe889cc4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:17.006358 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8fe00f2c-3605-4809-bedc-f547fe889cc4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:17.007102 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8fe00f2c-3605-4809-bedc-f547fe889cc4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:17.007577 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8fe00f2c-3605-4809-bedc-f547fe889cc4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:17.007994 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8fe00f2c-3605-4809-bedc-f547fe889cc4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:17.156877 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8fe00f2c-3605-4809-bedc-f547fe889cc4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:17.165275 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8fe00f2c-3605-4809-bedc-f547fe889cc4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.170587 Oct 06 12:23:17.165965 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 70/148] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:16 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:17.209659 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-868b7495-4c7c-47b0-8917-a05a49265428 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:17.210272 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-868b7495-4c7c-47b0-8917-a05a49265428 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:17.217526 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-868b7495-4c7c-47b0-8917-a05a49265428 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:17.218021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-868b7495-4c7c-47b0-8917-a05a49265428 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:17.218461 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-868b7495-4c7c-47b0-8917-a05a49265428 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:17.219152 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-868b7495-4c7c-47b0-8917-a05a49265428 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:17.219635 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-868b7495-4c7c-47b0-8917-a05a49265428 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:17.220065 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-868b7495-4c7c-47b0-8917-a05a49265428 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:17.404438 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-868b7495-4c7c-47b0-8917-a05a49265428 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:17.412616 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-868b7495-4c7c-47b0-8917-a05a49265428 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.206765 Oct 06 12:23:17.413190 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 79/149] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:17 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:17.744551 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-15d9888c-0d48-47ce-b94e-cd2531247e23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:17.745375 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-15d9888c-0d48-47ce-b94e-cd2531247e23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:17.763288 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-15d9888c-0d48-47ce-b94e-cd2531247e23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:17.766869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-15d9888c-0d48-47ce-b94e-cd2531247e23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:17.767369 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-15d9888c-0d48-47ce-b94e-cd2531247e23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:17.768061 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-15d9888c-0d48-47ce-b94e-cd2531247e23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:17.768592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-15d9888c-0d48-47ce-b94e-cd2531247e23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:17.769116 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-15d9888c-0d48-47ce-b94e-cd2531247e23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:17.902325 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-8e39338c-63d5-437f-b89c-ef1faa6902da req-dc7b55af-6793-43c4-9a7f-fbff2d21fde3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ff3ab6-55a2-45ae-a912-59faf8868070", "name": "network-vif-plugged", "status": "completed", "tag": "180aaafa-49f4-4890-afea-eb300c2b071f"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:23:17.919315 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-8e39338c-63d5-437f-b89c-ef1faa6902da req-dc7b55af-6793-43c4-9a7f-fbff2d21fde3 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:17.923849 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-8e39338c-63d5-437f-b89c-ef1faa6902da req-dc7b55af-6793-43c4-9a7f-fbff2d21fde3 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:17.924327 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-8e39338c-63d5-437f-b89c-ef1faa6902da req-dc7b55af-6793-43c4-9a7f-fbff2d21fde3 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:17.945318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-8e39338c-63d5-437f-b89c-ef1faa6902da req-dc7b55af-6793-43c4-9a7f-fbff2d21fde3 service nova] Creating event network-vif-plugged:180aaafa-49f4-4890-afea-eb300c2b071f for instance d1ff3ab6-55a2-45ae-a912-59faf8868070 on hv-cinder-85604 Oct 06 12:23:17.955980 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-8e39338c-63d5-437f-b89c-ef1faa6902da req-dc7b55af-6793-43c4-9a7f-fbff2d21fde3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059095 Oct 06 12:23:17.956899 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 80/150] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:23:17.994719 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-15d9888c-0d48-47ce-b94e-cd2531247e23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:18.004724 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-15d9888c-0d48-47ce-b94e-cd2531247e23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.263823 Oct 06 12:23:18.005307 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 71/151] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:17 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:18.192852 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1bdfbb7b-640a-46bf-92c4-33bc0d628910 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:18.194629 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-1bdfbb7b-640a-46bf-92c4-33bc0d628910 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:18.201049 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1bdfbb7b-640a-46bf-92c4-33bc0d628910 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:18.201580 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1bdfbb7b-640a-46bf-92c4-33bc0d628910 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:18.201995 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1bdfbb7b-640a-46bf-92c4-33bc0d628910 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:18.202674 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1bdfbb7b-640a-46bf-92c4-33bc0d628910 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:18.203127 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1bdfbb7b-640a-46bf-92c4-33bc0d628910 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:18.203679 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1bdfbb7b-640a-46bf-92c4-33bc0d628910 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:18.377152 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-1bdfbb7b-640a-46bf-92c4-33bc0d628910 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:18.390494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-1bdfbb7b-640a-46bf-92c4-33bc0d628910 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.201720 Oct 06 12:23:18.392644 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 81/152] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:18 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:18.436735 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-145bc627-a59e-4b08-8ef3-d505ef28912c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:18.437589 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-145bc627-a59e-4b08-8ef3-d505ef28912c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:18.444193 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-145bc627-a59e-4b08-8ef3-d505ef28912c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:18.444675 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-145bc627-a59e-4b08-8ef3-d505ef28912c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:18.445344 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-145bc627-a59e-4b08-8ef3-d505ef28912c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:18.446122 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-145bc627-a59e-4b08-8ef3-d505ef28912c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:18.446658 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-145bc627-a59e-4b08-8ef3-d505ef28912c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:18.447421 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-145bc627-a59e-4b08-8ef3-d505ef28912c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:18.602721 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-145bc627-a59e-4b08-8ef3-d505ef28912c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:18.610545 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-145bc627-a59e-4b08-8ef3-d505ef28912c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.177631 Oct 06 12:23:18.611571 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 72/153] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:18 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:19.029465 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-53b50265-57bc-4f57-ac4e-a9b56e727bd5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:19.030150 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-53b50265-57bc-4f57-ac4e-a9b56e727bd5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:19.037124 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53b50265-57bc-4f57-ac4e-a9b56e727bd5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:19.037684 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53b50265-57bc-4f57-ac4e-a9b56e727bd5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:19.038188 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53b50265-57bc-4f57-ac4e-a9b56e727bd5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:19.038949 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53b50265-57bc-4f57-ac4e-a9b56e727bd5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:19.039408 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53b50265-57bc-4f57-ac4e-a9b56e727bd5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:19.039861 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53b50265-57bc-4f57-ac4e-a9b56e727bd5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:19.165064 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-53b50265-57bc-4f57-ac4e-a9b56e727bd5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:19.172733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-53b50265-57bc-4f57-ac4e-a9b56e727bd5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.148708 Oct 06 12:23:19.173287 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 82/154] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:19 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:19.413916 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a6b959af-1a31-4dcf-bd0c-2aa747cd3f63 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:19.414604 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a6b959af-1a31-4dcf-bd0c-2aa747cd3f63 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:19.417103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=75 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:19.422002 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a6b959af-1a31-4dcf-bd0c-2aa747cd3f63 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:19.422559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a6b959af-1a31-4dcf-bd0c-2aa747cd3f63 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:19.423004 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a6b959af-1a31-4dcf-bd0c-2aa747cd3f63 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:19.423719 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a6b959af-1a31-4dcf-bd0c-2aa747cd3f63 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:19.424180 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a6b959af-1a31-4dcf-bd0c-2aa747cd3f63 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:19.424590 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a6b959af-1a31-4dcf-bd0c-2aa747cd3f63 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:19.558222 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a6b959af-1a31-4dcf-bd0c-2aa747cd3f63 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:19.567774 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a6b959af-1a31-4dcf-bd0c-2aa747cd3f63 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.157449 Oct 06 12:23:19.568456 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 73/155] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:19 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:19.633990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f309d4b5-6c2b-433e-9ea2-1b3962f89448 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:19.634655 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f309d4b5-6c2b-433e-9ea2-1b3962f89448 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:19.645010 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f309d4b5-6c2b-433e-9ea2-1b3962f89448 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:19.645506 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f309d4b5-6c2b-433e-9ea2-1b3962f89448 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:19.645969 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f309d4b5-6c2b-433e-9ea2-1b3962f89448 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:19.646697 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f309d4b5-6c2b-433e-9ea2-1b3962f89448 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:19.647151 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f309d4b5-6c2b-433e-9ea2-1b3962f89448 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:19.647679 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f309d4b5-6c2b-433e-9ea2-1b3962f89448 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:19.770878 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f309d4b5-6c2b-433e-9ea2-1b3962f89448 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:19.778878 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f309d4b5-6c2b-433e-9ea2-1b3962f89448 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.148644 Oct 06 12:23:19.779449 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 83/156] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:19 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:20.196581 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5cfd4de4-884f-4764-920a-5619a6cb4b96 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:20.197189 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5cfd4de4-884f-4764-920a-5619a6cb4b96 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:20.203025 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5cfd4de4-884f-4764-920a-5619a6cb4b96 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:20.203518 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5cfd4de4-884f-4764-920a-5619a6cb4b96 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:20.203962 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5cfd4de4-884f-4764-920a-5619a6cb4b96 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:20.204667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5cfd4de4-884f-4764-920a-5619a6cb4b96 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:20.205125 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5cfd4de4-884f-4764-920a-5619a6cb4b96 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:20.205546 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5cfd4de4-884f-4764-920a-5619a6cb4b96 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:20.337299 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5cfd4de4-884f-4764-920a-5619a6cb4b96 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:20.344929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5cfd4de4-884f-4764-920a-5619a6cb4b96 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.152097 Oct 06 12:23:20.345505 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 74/157] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:20 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:20.592488 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-412cccb9-5e79-4466-936d-6783e76c96c7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:20.593104 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-412cccb9-5e79-4466-936d-6783e76c96c7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:20.598982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-412cccb9-5e79-4466-936d-6783e76c96c7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:20.599483 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-412cccb9-5e79-4466-936d-6783e76c96c7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:20.599941 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-412cccb9-5e79-4466-936d-6783e76c96c7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:20.600611 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-412cccb9-5e79-4466-936d-6783e76c96c7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:20.601057 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-412cccb9-5e79-4466-936d-6783e76c96c7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:20.601475 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-412cccb9-5e79-4466-936d-6783e76c96c7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:20.724405 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-412cccb9-5e79-4466-936d-6783e76c96c7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:20.732549 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-412cccb9-5e79-4466-936d-6783e76c96c7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.144713 Oct 06 12:23:20.733105 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 84/158] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:20 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:20.801748 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-001f420a-d3be-4fe1-8dc5-f89a2b18b20c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:20.802348 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-001f420a-d3be-4fe1-8dc5-f89a2b18b20c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:20.808269 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-001f420a-d3be-4fe1-8dc5-f89a2b18b20c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:20.808681 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-001f420a-d3be-4fe1-8dc5-f89a2b18b20c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:20.809109 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-001f420a-d3be-4fe1-8dc5-f89a2b18b20c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:20.809779 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-001f420a-d3be-4fe1-8dc5-f89a2b18b20c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:20.810222 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-001f420a-d3be-4fe1-8dc5-f89a2b18b20c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:20.810641 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-001f420a-d3be-4fe1-8dc5-f89a2b18b20c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:20.936429 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-001f420a-d3be-4fe1-8dc5-f89a2b18b20c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:20.943947 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-001f420a-d3be-4fe1-8dc5-f89a2b18b20c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.146029 Oct 06 12:23:20.944507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 75/159] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:20 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:21.374268 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7dabf8f7-185b-4ff2-8cd1-baf617bbc0a5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:21.374874 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7dabf8f7-185b-4ff2-8cd1-baf617bbc0a5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:21.380789 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7dabf8f7-185b-4ff2-8cd1-baf617bbc0a5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:21.381373 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7dabf8f7-185b-4ff2-8cd1-baf617bbc0a5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:21.381796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7dabf8f7-185b-4ff2-8cd1-baf617bbc0a5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:21.382484 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7dabf8f7-185b-4ff2-8cd1-baf617bbc0a5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:21.382938 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7dabf8f7-185b-4ff2-8cd1-baf617bbc0a5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:21.383586 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7dabf8f7-185b-4ff2-8cd1-baf617bbc0a5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:21.510651 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7dabf8f7-185b-4ff2-8cd1-baf617bbc0a5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:21.518143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7dabf8f7-185b-4ff2-8cd1-baf617bbc0a5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.151753 Oct 06 12:23:21.518706 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 85/160] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:21 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:21.754000 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-81803c32-c463-4817-9428-3890f18f1265 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:21.754605 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-81803c32-c463-4817-9428-3890f18f1265 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:21.760424 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81803c32-c463-4817-9428-3890f18f1265 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:21.760895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81803c32-c463-4817-9428-3890f18f1265 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:21.761319 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81803c32-c463-4817-9428-3890f18f1265 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:21.761991 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81803c32-c463-4817-9428-3890f18f1265 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:21.762433 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81803c32-c463-4817-9428-3890f18f1265 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:21.762850 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81803c32-c463-4817-9428-3890f18f1265 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:21.885693 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-81803c32-c463-4817-9428-3890f18f1265 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:21.893308 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-81803c32-c463-4817-9428-3890f18f1265 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.143098 Oct 06 12:23:21.893882 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 76/161] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:21 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:21.966549 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ddf7ea7a-8ef9-4896-9d14-bf85446ea1ed tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:21.967160 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ddf7ea7a-8ef9-4896-9d14-bf85446ea1ed tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:21.973007 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ddf7ea7a-8ef9-4896-9d14-bf85446ea1ed tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:21.973491 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ddf7ea7a-8ef9-4896-9d14-bf85446ea1ed tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:21.973930 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ddf7ea7a-8ef9-4896-9d14-bf85446ea1ed tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:21.974617 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ddf7ea7a-8ef9-4896-9d14-bf85446ea1ed tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:21.975073 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ddf7ea7a-8ef9-4896-9d14-bf85446ea1ed tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:21.975497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ddf7ea7a-8ef9-4896-9d14-bf85446ea1ed tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:22.105126 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ddf7ea7a-8ef9-4896-9d14-bf85446ea1ed tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:22.112929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ddf7ea7a-8ef9-4896-9d14-bf85446ea1ed tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.150763 Oct 06 12:23:22.113494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 86/162] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:21 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:22.541100 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d068648c-478c-4132-94f7-427f1428ffb4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:22.541633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d068648c-478c-4132-94f7-427f1428ffb4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:22.547437 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d068648c-478c-4132-94f7-427f1428ffb4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:22.547942 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d068648c-478c-4132-94f7-427f1428ffb4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:22.548368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d068648c-478c-4132-94f7-427f1428ffb4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:22.549033 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d068648c-478c-4132-94f7-427f1428ffb4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:22.549473 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d068648c-478c-4132-94f7-427f1428ffb4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:22.549886 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d068648c-478c-4132-94f7-427f1428ffb4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:22.675694 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d068648c-478c-4132-94f7-427f1428ffb4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:22.684094 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d068648c-478c-4132-94f7-427f1428ffb4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.146717 Oct 06 12:23:22.684752 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 77/163] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:22 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:22.916550 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2fc6abf2-22c0-4908-babd-13456b9bfd08 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:22.917164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2fc6abf2-22c0-4908-babd-13456b9bfd08 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:22.923013 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2fc6abf2-22c0-4908-babd-13456b9bfd08 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:22.923495 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2fc6abf2-22c0-4908-babd-13456b9bfd08 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:22.923959 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2fc6abf2-22c0-4908-babd-13456b9bfd08 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:22.924641 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2fc6abf2-22c0-4908-babd-13456b9bfd08 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:22.925098 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2fc6abf2-22c0-4908-babd-13456b9bfd08 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:22.925524 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2fc6abf2-22c0-4908-babd-13456b9bfd08 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:23.054361 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2fc6abf2-22c0-4908-babd-13456b9bfd08 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:23.062427 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2fc6abf2-22c0-4908-babd-13456b9bfd08 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.149708 Oct 06 12:23:23.062995 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 87/164] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:22 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:23.136219 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-203fb2c4-be76-47c4-a7d6-fdb8bf93cc11 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:23.136830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-203fb2c4-be76-47c4-a7d6-fdb8bf93cc11 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:23.142667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-203fb2c4-be76-47c4-a7d6-fdb8bf93cc11 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:23.143156 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-203fb2c4-be76-47c4-a7d6-fdb8bf93cc11 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:23.143625 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-203fb2c4-be76-47c4-a7d6-fdb8bf93cc11 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:23.144311 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-203fb2c4-be76-47c4-a7d6-fdb8bf93cc11 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:23.144765 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-203fb2c4-be76-47c4-a7d6-fdb8bf93cc11 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:23.145184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-203fb2c4-be76-47c4-a7d6-fdb8bf93cc11 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:23.269175 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-203fb2c4-be76-47c4-a7d6-fdb8bf93cc11 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:23.276533 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-203fb2c4-be76-47c4-a7d6-fdb8bf93cc11 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.144910 Oct 06 12:23:23.277220 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 78/165] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:23 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:23.706760 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-16cc90dc-11c2-43f6-aca9-7811fc42d353 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:23.707364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-16cc90dc-11c2-43f6-aca9-7811fc42d353 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:23.709321 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=82 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:23.715046 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16cc90dc-11c2-43f6-aca9-7811fc42d353 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:23.715638 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16cc90dc-11c2-43f6-aca9-7811fc42d353 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:23.716083 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16cc90dc-11c2-43f6-aca9-7811fc42d353 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:23.716773 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16cc90dc-11c2-43f6-aca9-7811fc42d353 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:23.717565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16cc90dc-11c2-43f6-aca9-7811fc42d353 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:23.717666 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16cc90dc-11c2-43f6-aca9-7811fc42d353 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:23.844297 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-16cc90dc-11c2-43f6-aca9-7811fc42d353 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:23.851840 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-16cc90dc-11c2-43f6-aca9-7811fc42d353 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.148905 Oct 06 12:23:23.852401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 88/166] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:23 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:24.085757 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-69966375-b591-454d-a62a-cdc493bc4dae tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:24.086463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-69966375-b591-454d-a62a-cdc493bc4dae tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:24.092601 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69966375-b591-454d-a62a-cdc493bc4dae tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:24.093224 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69966375-b591-454d-a62a-cdc493bc4dae tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:24.093665 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69966375-b591-454d-a62a-cdc493bc4dae tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:24.094353 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69966375-b591-454d-a62a-cdc493bc4dae tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:24.094809 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69966375-b591-454d-a62a-cdc493bc4dae tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:24.095230 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69966375-b591-454d-a62a-cdc493bc4dae tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:24.226649 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-69966375-b591-454d-a62a-cdc493bc4dae tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:24.235315 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-69966375-b591-454d-a62a-cdc493bc4dae tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.153447 Oct 06 12:23:24.235919 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 79/167] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:24 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:24.299475 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e03bd9c1-5f18-4c47-8423-899df39e71d4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:24.300137 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e03bd9c1-5f18-4c47-8423-899df39e71d4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:24.306916 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e03bd9c1-5f18-4c47-8423-899df39e71d4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:24.307397 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e03bd9c1-5f18-4c47-8423-899df39e71d4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:24.307854 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e03bd9c1-5f18-4c47-8423-899df39e71d4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:24.308537 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e03bd9c1-5f18-4c47-8423-899df39e71d4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:24.308989 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e03bd9c1-5f18-4c47-8423-899df39e71d4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:24.309407 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e03bd9c1-5f18-4c47-8423-899df39e71d4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:24.432624 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e03bd9c1-5f18-4c47-8423-899df39e71d4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:24.440166 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e03bd9c1-5f18-4c47-8423-899df39e71d4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.144494 Oct 06 12:23:24.440731 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 89/168] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:24 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:24.874076 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7bbd200c-ebfa-463b-9830-778476c079b9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:24.874702 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7bbd200c-ebfa-463b-9830-778476c079b9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:24.880435 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7bbd200c-ebfa-463b-9830-778476c079b9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:24.880911 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7bbd200c-ebfa-463b-9830-778476c079b9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:24.881335 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7bbd200c-ebfa-463b-9830-778476c079b9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:24.882007 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7bbd200c-ebfa-463b-9830-778476c079b9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:24.882449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7bbd200c-ebfa-463b-9830-778476c079b9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:24.882861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7bbd200c-ebfa-463b-9830-778476c079b9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:24.902306 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=100 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:25.013207 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7bbd200c-ebfa-463b-9830-778476c079b9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:25.020763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7bbd200c-ebfa-463b-9830-778476c079b9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.150537 Oct 06 12:23:25.021315 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 80/169] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:24 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:25.258277 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-77c0b3fd-9814-4927-8536-e761993d82e7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:25.258989 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-77c0b3fd-9814-4927-8536-e761993d82e7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:25.265487 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77c0b3fd-9814-4927-8536-e761993d82e7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:25.265976 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77c0b3fd-9814-4927-8536-e761993d82e7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:25.266417 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77c0b3fd-9814-4927-8536-e761993d82e7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:25.267154 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77c0b3fd-9814-4927-8536-e761993d82e7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:25.267710 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77c0b3fd-9814-4927-8536-e761993d82e7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:25.268142 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77c0b3fd-9814-4927-8536-e761993d82e7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:25.401958 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-77c0b3fd-9814-4927-8536-e761993d82e7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:25.409875 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-77c0b3fd-9814-4927-8536-e761993d82e7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.155572 Oct 06 12:23:25.410444 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 90/170] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:25 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:25.464344 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-081e889a-0988-4bd9-a650-85d2122e6b55 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:25.464958 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-081e889a-0988-4bd9-a650-85d2122e6b55 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:25.470902 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-081e889a-0988-4bd9-a650-85d2122e6b55 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:25.471384 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-081e889a-0988-4bd9-a650-85d2122e6b55 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:25.471883 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-081e889a-0988-4bd9-a650-85d2122e6b55 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:25.472573 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-081e889a-0988-4bd9-a650-85d2122e6b55 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:25.473023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-081e889a-0988-4bd9-a650-85d2122e6b55 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:25.473444 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-081e889a-0988-4bd9-a650-85d2122e6b55 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:25.684891 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-081e889a-0988-4bd9-a650-85d2122e6b55 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:25.700298 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-081e889a-0988-4bd9-a650-85d2122e6b55 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.239729 Oct 06 12:23:25.701481 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 81/171] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:25 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:26.044970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-cc159bdb-9dc9-4fd9-8a49-a9c1a167c379 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:26.048863 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-cc159bdb-9dc9-4fd9-8a49-a9c1a167c379 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:26.058567 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cc159bdb-9dc9-4fd9-8a49-a9c1a167c379 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:26.058927 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cc159bdb-9dc9-4fd9-8a49-a9c1a167c379 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:26.059359 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cc159bdb-9dc9-4fd9-8a49-a9c1a167c379 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:26.060081 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cc159bdb-9dc9-4fd9-8a49-a9c1a167c379 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:26.060528 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cc159bdb-9dc9-4fd9-8a49-a9c1a167c379 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:26.060948 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cc159bdb-9dc9-4fd9-8a49-a9c1a167c379 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:26.243629 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-cc159bdb-9dc9-4fd9-8a49-a9c1a167c379 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:26.250358 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-cc159bdb-9dc9-4fd9-8a49-a9c1a167c379 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.209158 Oct 06 12:23:26.250935 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 91/172] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:26 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:26.432351 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5e8eb9f5-1417-41f0-b704-f2ce7b947216 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:26.432956 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5e8eb9f5-1417-41f0-b704-f2ce7b947216 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:26.438792 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5e8eb9f5-1417-41f0-b704-f2ce7b947216 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:26.439264 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5e8eb9f5-1417-41f0-b704-f2ce7b947216 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:26.439736 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5e8eb9f5-1417-41f0-b704-f2ce7b947216 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:26.440408 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5e8eb9f5-1417-41f0-b704-f2ce7b947216 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:26.440855 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5e8eb9f5-1417-41f0-b704-f2ce7b947216 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:26.441267 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5e8eb9f5-1417-41f0-b704-f2ce7b947216 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:26.572565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5e8eb9f5-1417-41f0-b704-f2ce7b947216 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:26.580045 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5e8eb9f5-1417-41f0-b704-f2ce7b947216 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.151633 Oct 06 12:23:26.580605 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 82/173] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:26 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:26.727460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-860e7fd7-a452-4e52-9883-921cd051bbbf tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:26.728156 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-860e7fd7-a452-4e52-9883-921cd051bbbf tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:26.734384 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-860e7fd7-a452-4e52-9883-921cd051bbbf tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:26.734872 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-860e7fd7-a452-4e52-9883-921cd051bbbf tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:26.735304 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-860e7fd7-a452-4e52-9883-921cd051bbbf tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:26.736357 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-860e7fd7-a452-4e52-9883-921cd051bbbf tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:26.736973 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-860e7fd7-a452-4e52-9883-921cd051bbbf tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:26.737407 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-860e7fd7-a452-4e52-9883-921cd051bbbf tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:27.053356 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-212e666d-bdab-4b6e-91bd-550df39f03b9 req-87943a1f-6c2a-4448-b004-68bb73b3d86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "518de8e1-7379-4cc4-98da-0f042318420b", "name": "network-vif-plugged", "status": "completed", "tag": "b3316e74-8f06-454a-ad05-4f9d36155fe9"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:23:27.076238 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-212e666d-bdab-4b6e-91bd-550df39f03b9 req-87943a1f-6c2a-4448-b004-68bb73b3d86c service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:27.076906 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-212e666d-bdab-4b6e-91bd-550df39f03b9 req-87943a1f-6c2a-4448-b004-68bb73b3d86c service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:27.077487 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-212e666d-bdab-4b6e-91bd-550df39f03b9 req-87943a1f-6c2a-4448-b004-68bb73b3d86c service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:27.111377 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-212e666d-bdab-4b6e-91bd-550df39f03b9 req-87943a1f-6c2a-4448-b004-68bb73b3d86c service nova] Creating event network-vif-plugged:b3316e74-8f06-454a-ad05-4f9d36155fe9 for instance 518de8e1-7379-4cc4-98da-0f042318420b on hv-cinder-85604 Oct 06 12:23:27.111941 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-212e666d-bdab-4b6e-91bd-550df39f03b9 req-87943a1f-6c2a-4448-b004-68bb73b3d86c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120509) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 12:23:27.112384 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-212e666d-bdab-4b6e-91bd-550df39f03b9 req-87943a1f-6c2a-4448-b004-68bb73b3d86c service nova] Acquired lock "compute-rpcapi-router" {{(pid=120509) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 12:23:27.116984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9760ebcb-6b47-405e-bf66-361bc61a5694 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:27.117519 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9760ebcb-6b47-405e-bf66-361bc61a5694 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:27.117948 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9760ebcb-6b47-405e-bf66-361bc61a5694 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:27.119675 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9760ebcb-6b47-405e-bf66-361bc61a5694 None None] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:27.120366 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9760ebcb-6b47-405e-bf66-361bc61a5694 None None] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:27.120973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9760ebcb-6b47-405e-bf66-361bc61a5694 None None] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:27.133317 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.compute.rpcapi [None req-9760ebcb-6b47-405e-bf66-361bc61a5694 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 06 12:23:27.134565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9760ebcb-6b47-405e-bf66-361bc61a5694 None None] Releasing lock "compute-rpcapi-router" {{(pid=120509) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 12:23:27.189339 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9760ebcb-6b47-405e-bf66-361bc61a5694 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139562 Oct 06 12:23:27.193163 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 83/174] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:23:27.270866 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-860e7fd7-a452-4e52-9883-921cd051bbbf tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:27.275217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-dafea5b5-f6b1-4216-a825-3a348720fe33 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:27.276213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-dafea5b5-f6b1-4216-a825-3a348720fe33 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:27.279035 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=100 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:27.282381 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-860e7fd7-a452-4e52-9883-921cd051bbbf tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.558426 Oct 06 12:23:27.283960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-dafea5b5-f6b1-4216-a825-3a348720fe33 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:27.284705 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-dafea5b5-f6b1-4216-a825-3a348720fe33 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:27.285132 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-dafea5b5-f6b1-4216-a825-3a348720fe33 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:27.285932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-dafea5b5-f6b1-4216-a825-3a348720fe33 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:27.286252 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-dafea5b5-f6b1-4216-a825-3a348720fe33 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:27.286851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-dafea5b5-f6b1-4216-a825-3a348720fe33 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:27.296945 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 92/175] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:26 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:27.453810 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-dafea5b5-f6b1-4216-a825-3a348720fe33 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:27.469872 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-dafea5b5-f6b1-4216-a825-3a348720fe33 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.199548 Oct 06 12:23:27.471733 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 84/176] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:27 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:27.604689 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-72d77f47-853b-48a9-a538-4a9bda485260 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:27.605288 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-72d77f47-853b-48a9-a538-4a9bda485260 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:27.613880 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-72d77f47-853b-48a9-a538-4a9bda485260 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:27.614429 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-72d77f47-853b-48a9-a538-4a9bda485260 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:27.614876 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-72d77f47-853b-48a9-a538-4a9bda485260 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:27.615590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-72d77f47-853b-48a9-a538-4a9bda485260 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:27.616038 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-72d77f47-853b-48a9-a538-4a9bda485260 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:27.616481 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-72d77f47-853b-48a9-a538-4a9bda485260 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:27.908560 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-72d77f47-853b-48a9-a538-4a9bda485260 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:27.917713 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-72d77f47-853b-48a9-a538-4a9bda485260 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.317521 Oct 06 12:23:27.918452 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 93/177] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:27 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:28.308190 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0de2d54e-269f-43d9-ae5c-10f98152c824 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:28.308839 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0de2d54e-269f-43d9-ae5c-10f98152c824 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:28.314762 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0de2d54e-269f-43d9-ae5c-10f98152c824 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:28.315239 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0de2d54e-269f-43d9-ae5c-10f98152c824 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:28.315751 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0de2d54e-269f-43d9-ae5c-10f98152c824 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:28.316424 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0de2d54e-269f-43d9-ae5c-10f98152c824 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:28.316937 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0de2d54e-269f-43d9-ae5c-10f98152c824 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:28.317357 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0de2d54e-269f-43d9-ae5c-10f98152c824 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:28.449105 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0de2d54e-269f-43d9-ae5c-10f98152c824 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:28.457134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0de2d54e-269f-43d9-ae5c-10f98152c824 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.153472 Oct 06 12:23:28.457698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 85/178] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:28 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:28.494979 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a7dbafea-6192-4bf0-b0e7-1cf1455650ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:28.495617 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a7dbafea-6192-4bf0-b0e7-1cf1455650ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:28.501554 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a7dbafea-6192-4bf0-b0e7-1cf1455650ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:28.502139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a7dbafea-6192-4bf0-b0e7-1cf1455650ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:28.502536 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a7dbafea-6192-4bf0-b0e7-1cf1455650ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:28.503222 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a7dbafea-6192-4bf0-b0e7-1cf1455650ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:28.503703 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a7dbafea-6192-4bf0-b0e7-1cf1455650ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:28.504215 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a7dbafea-6192-4bf0-b0e7-1cf1455650ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:28.637289 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a7dbafea-6192-4bf0-b0e7-1cf1455650ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:28.644839 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a7dbafea-6192-4bf0-b0e7-1cf1455650ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.154516 Oct 06 12:23:28.645421 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 94/179] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:28 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:28.940039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d266abd2-7ba6-4209-a9b3-801b772a1834 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:28.940563 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d266abd2-7ba6-4209-a9b3-801b772a1834 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:28.947651 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d266abd2-7ba6-4209-a9b3-801b772a1834 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:28.948136 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d266abd2-7ba6-4209-a9b3-801b772a1834 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:28.948567 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d266abd2-7ba6-4209-a9b3-801b772a1834 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:28.949247 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d266abd2-7ba6-4209-a9b3-801b772a1834 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:28.949723 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d266abd2-7ba6-4209-a9b3-801b772a1834 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:28.951617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d266abd2-7ba6-4209-a9b3-801b772a1834 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:29.263152 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d266abd2-7ba6-4209-a9b3-801b772a1834 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:29.270995 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d266abd2-7ba6-4209-a9b3-801b772a1834 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.334869 Oct 06 12:23:29.271602 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 86/180] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:28 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:29.481351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c3b0b558-391c-4022-9df7-91a71521e660 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:29.481927 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c3b0b558-391c-4022-9df7-91a71521e660 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:29.487718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3b0b558-391c-4022-9df7-91a71521e660 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:29.488202 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3b0b558-391c-4022-9df7-91a71521e660 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:29.488642 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3b0b558-391c-4022-9df7-91a71521e660 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:29.489327 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3b0b558-391c-4022-9df7-91a71521e660 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:29.489779 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3b0b558-391c-4022-9df7-91a71521e660 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:29.490202 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3b0b558-391c-4022-9df7-91a71521e660 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:29.629064 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c3b0b558-391c-4022-9df7-91a71521e660 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:29.637126 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c3b0b558-391c-4022-9df7-91a71521e660 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.160235 Oct 06 12:23:29.637763 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 95/181] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:29 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:29.668746 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7022507a-3ae3-451a-b0aa-c99abf458711 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:29.669669 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7022507a-3ae3-451a-b0aa-c99abf458711 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:29.676309 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7022507a-3ae3-451a-b0aa-c99abf458711 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:29.676972 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7022507a-3ae3-451a-b0aa-c99abf458711 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:29.677635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7022507a-3ae3-451a-b0aa-c99abf458711 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:29.678419 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7022507a-3ae3-451a-b0aa-c99abf458711 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:29.678968 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7022507a-3ae3-451a-b0aa-c99abf458711 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:29.679612 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7022507a-3ae3-451a-b0aa-c99abf458711 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:30.058826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7022507a-3ae3-451a-b0aa-c99abf458711 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:30.066619 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7022507a-3ae3-451a-b0aa-c99abf458711 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1322 microversion: 2.1 time: 0.401975 Oct 06 12:23:30.067606 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 87/182] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:29 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:30.294786 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7e1fcfaa-3651-469e-bbdf-76ce96385e59 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:30.296096 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7e1fcfaa-3651-469e-bbdf-76ce96385e59 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:30.302385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e1fcfaa-3651-469e-bbdf-76ce96385e59 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:30.303238 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e1fcfaa-3651-469e-bbdf-76ce96385e59 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:30.303771 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e1fcfaa-3651-469e-bbdf-76ce96385e59 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:30.304469 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e1fcfaa-3651-469e-bbdf-76ce96385e59 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:30.305126 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e1fcfaa-3651-469e-bbdf-76ce96385e59 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:30.305336 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e1fcfaa-3651-469e-bbdf-76ce96385e59 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:30.455009 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7e1fcfaa-3651-469e-bbdf-76ce96385e59 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:30.464160 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7e1fcfaa-3651-469e-bbdf-76ce96385e59 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.174392 Oct 06 12:23:30.464912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 96/183] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:30 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:30.664370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4f8518a5-0ca1-45a9-ac01-32817a827524 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:30.665181 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4f8518a5-0ca1-45a9-ac01-32817a827524 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:30.672606 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4f8518a5-0ca1-45a9-ac01-32817a827524 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:30.673734 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4f8518a5-0ca1-45a9-ac01-32817a827524 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:30.674580 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4f8518a5-0ca1-45a9-ac01-32817a827524 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:30.675434 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4f8518a5-0ca1-45a9-ac01-32817a827524 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:30.676055 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4f8518a5-0ca1-45a9-ac01-32817a827524 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:30.676630 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4f8518a5-0ca1-45a9-ac01-32817a827524 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:30.839663 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4f8518a5-0ca1-45a9-ac01-32817a827524 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:30.849322 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4f8518a5-0ca1-45a9-ac01-32817a827524 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.192378 Oct 06 12:23:30.849885 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 88/184] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:30 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:31.094372 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ff7ba2ca-2cbf-4abe-bfb4-9276a2669527 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:31.095046 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ff7ba2ca-2cbf-4abe-bfb4-9276a2669527 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:31.104547 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ff7ba2ca-2cbf-4abe-bfb4-9276a2669527 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:31.104547 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ff7ba2ca-2cbf-4abe-bfb4-9276a2669527 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:31.104547 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ff7ba2ca-2cbf-4abe-bfb4-9276a2669527 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:31.106510 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ff7ba2ca-2cbf-4abe-bfb4-9276a2669527 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:31.106600 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ff7ba2ca-2cbf-4abe-bfb4-9276a2669527 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:31.107023 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ff7ba2ca-2cbf-4abe-bfb4-9276a2669527 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:31.289616 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ff7ba2ca-2cbf-4abe-bfb4-9276a2669527 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:31.299912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ff7ba2ca-2cbf-4abe-bfb4-9276a2669527 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1516 microversion: 2.1 time: 0.211970 Oct 06 12:23:31.300652 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 97/185] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:31 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1516 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:31.325005 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ca1fc7cd-e76a-4a67-ab89-24cbb5b3f27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:23:31.330645 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ca1fc7cd-e76a-4a67-ab89-24cbb5b3f27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:31.344617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ca1fc7cd-e76a-4a67-ab89-24cbb5b3f27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:31.345329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ca1fc7cd-e76a-4a67-ab89-24cbb5b3f27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:31.345901 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ca1fc7cd-e76a-4a67-ab89-24cbb5b3f27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:31.346610 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ca1fc7cd-e76a-4a67-ab89-24cbb5b3f27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:31.347066 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ca1fc7cd-e76a-4a67-ab89-24cbb5b3f27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:31.347991 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ca1fc7cd-e76a-4a67-ab89-24cbb5b3f27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:31.427858 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-ca1fc7cd-e76a-4a67-ab89-24cbb5b3f27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lazy-loading 'flavor' on Instance uuid d1ff3ab6-55a2-45ae-a912-59faf8868070 {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:23:31.491160 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e676404b-ed94-470d-81e0-bd2a89b1b904 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:31.492063 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e676404b-ed94-470d-81e0-bd2a89b1b904 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:31.499605 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e676404b-ed94-470d-81e0-bd2a89b1b904 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:31.500360 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e676404b-ed94-470d-81e0-bd2a89b1b904 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:31.501149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e676404b-ed94-470d-81e0-bd2a89b1b904 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:31.502251 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e676404b-ed94-470d-81e0-bd2a89b1b904 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:31.502917 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e676404b-ed94-470d-81e0-bd2a89b1b904 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:31.503610 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e676404b-ed94-470d-81e0-bd2a89b1b904 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:31.580738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ca1fc7cd-e76a-4a67-ab89-24cbb5b3f27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "POST /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070/action" status: 200 len: 32 microversion: 2.1 time: 0.260164 Oct 06 12:23:31.585999 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 89/186] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 12:23:31 2022] POST /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070/action => generated 32 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:23:31.609741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a494f3f3-bf54-4bc2-a6e8-ac84350bfcce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:31.610440 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a494f3f3-bf54-4bc2-a6e8-ac84350bfcce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:31.617004 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a494f3f3-bf54-4bc2-a6e8-ac84350bfcce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:31.617508 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a494f3f3-bf54-4bc2-a6e8-ac84350bfcce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:31.617936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a494f3f3-bf54-4bc2-a6e8-ac84350bfcce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:31.618624 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a494f3f3-bf54-4bc2-a6e8-ac84350bfcce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:31.619065 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a494f3f3-bf54-4bc2-a6e8-ac84350bfcce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:31.619470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a494f3f3-bf54-4bc2-a6e8-ac84350bfcce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:31.656159 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e676404b-ed94-470d-81e0-bd2a89b1b904 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:31.664213 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e676404b-ed94-470d-81e0-bd2a89b1b904 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.178966 Oct 06 12:23:31.664779 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 98/187] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:31 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:31.764719 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a494f3f3-bf54-4bc2-a6e8-ac84350bfcce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:31.773327 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a494f3f3-bf54-4bc2-a6e8-ac84350bfcce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.185249 Oct 06 12:23:31.773893 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 90/188] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:31 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:31.874889 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-099b38ae-95e8-49b2-a18d-9780807d5584 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:31.876216 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-099b38ae-95e8-49b2-a18d-9780807d5584 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:31.885767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-099b38ae-95e8-49b2-a18d-9780807d5584 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:31.886347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-099b38ae-95e8-49b2-a18d-9780807d5584 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:31.886872 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-099b38ae-95e8-49b2-a18d-9780807d5584 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:31.887715 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-099b38ae-95e8-49b2-a18d-9780807d5584 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:31.888243 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-099b38ae-95e8-49b2-a18d-9780807d5584 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:31.888746 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-099b38ae-95e8-49b2-a18d-9780807d5584 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:32.027720 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-099b38ae-95e8-49b2-a18d-9780807d5584 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:32.037053 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-099b38ae-95e8-49b2-a18d-9780807d5584 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1314 microversion: 2.1 time: 0.168530 Oct 06 12:23:32.037796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 99/189] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:31 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:32.687495 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ce97fdd4-bfee-4875-8393-4c3928e78d02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:32.688202 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ce97fdd4-bfee-4875-8393-4c3928e78d02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:32.694412 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce97fdd4-bfee-4875-8393-4c3928e78d02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:32.694925 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce97fdd4-bfee-4875-8393-4c3928e78d02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:32.695357 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce97fdd4-bfee-4875-8393-4c3928e78d02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:32.696074 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce97fdd4-bfee-4875-8393-4c3928e78d02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:32.697138 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce97fdd4-bfee-4875-8393-4c3928e78d02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:32.697558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce97fdd4-bfee-4875-8393-4c3928e78d02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:32.798352 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5f1e66f7-5eec-43a8-91da-533140304357 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:32.799348 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5f1e66f7-5eec-43a8-91da-533140304357 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:32.806238 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f1e66f7-5eec-43a8-91da-533140304357 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:32.806799 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f1e66f7-5eec-43a8-91da-533140304357 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:32.807296 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f1e66f7-5eec-43a8-91da-533140304357 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:32.808189 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f1e66f7-5eec-43a8-91da-533140304357 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:32.808597 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f1e66f7-5eec-43a8-91da-533140304357 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:32.809085 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f1e66f7-5eec-43a8-91da-533140304357 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:32.839382 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ce97fdd4-bfee-4875-8393-4c3928e78d02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:32.847876 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ce97fdd4-bfee-4875-8393-4c3928e78d02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.164103 Oct 06 12:23:32.848607 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 91/190] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:32 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:32.941459 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5f1e66f7-5eec-43a8-91da-533140304357 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:32.949880 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5f1e66f7-5eec-43a8-91da-533140304357 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.156307 Oct 06 12:23:32.950663 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 100/191] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:32 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:33.059726 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-318aba90-1373-4848-a923-d505b1fdccd8 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:33.060289 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-318aba90-1373-4848-a923-d505b1fdccd8 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:33.066037 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-318aba90-1373-4848-a923-d505b1fdccd8 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:33.066589 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-318aba90-1373-4848-a923-d505b1fdccd8 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:33.067206 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-318aba90-1373-4848-a923-d505b1fdccd8 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:33.067915 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-318aba90-1373-4848-a923-d505b1fdccd8 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:33.068355 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-318aba90-1373-4848-a923-d505b1fdccd8 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:33.068968 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-318aba90-1373-4848-a923-d505b1fdccd8 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:33.214534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-318aba90-1373-4848-a923-d505b1fdccd8 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:33.223104 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-318aba90-1373-4848-a923-d505b1fdccd8 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1500 microversion: 2.1 time: 0.167332 Oct 06 12:23:33.223795 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 92/192] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:33 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1500 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:33.872445 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3c062f38-de7a-41d1-8a42-7f417ea6de45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:33.873048 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3c062f38-de7a-41d1-8a42-7f417ea6de45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:33.879997 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3c062f38-de7a-41d1-8a42-7f417ea6de45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:33.880637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3c062f38-de7a-41d1-8a42-7f417ea6de45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:33.881211 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3c062f38-de7a-41d1-8a42-7f417ea6de45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:33.882063 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3c062f38-de7a-41d1-8a42-7f417ea6de45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:33.882653 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3c062f38-de7a-41d1-8a42-7f417ea6de45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:33.883227 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3c062f38-de7a-41d1-8a42-7f417ea6de45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:33.973899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-6d5442de-aead-418a-b8a7-ccc6c2b816f5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:33.974670 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-6d5442de-aead-418a-b8a7-ccc6c2b816f5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:33.984474 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6d5442de-aead-418a-b8a7-ccc6c2b816f5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:33.984844 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6d5442de-aead-418a-b8a7-ccc6c2b816f5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:33.985449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6d5442de-aead-418a-b8a7-ccc6c2b816f5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:33.986136 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6d5442de-aead-418a-b8a7-ccc6c2b816f5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:33.986719 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6d5442de-aead-418a-b8a7-ccc6c2b816f5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:33.987291 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6d5442de-aead-418a-b8a7-ccc6c2b816f5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:34.018220 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3c062f38-de7a-41d1-8a42-7f417ea6de45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:34.028023 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3c062f38-de7a-41d1-8a42-7f417ea6de45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.159026 Oct 06 12:23:34.028023 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 101/193] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:33 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:34.120649 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-6d5442de-aead-418a-b8a7-ccc6c2b816f5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:34.128254 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-6d5442de-aead-418a-b8a7-ccc6c2b816f5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.158070 Oct 06 12:23:34.128862 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 93/194] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:33 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:35.049551 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c3e77dfc-2e27-4a07-a034-71574fbba681 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:35.050158 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c3e77dfc-2e27-4a07-a034-71574fbba681 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:35.056224 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3e77dfc-2e27-4a07-a034-71574fbba681 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:35.056710 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3e77dfc-2e27-4a07-a034-71574fbba681 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:35.057165 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3e77dfc-2e27-4a07-a034-71574fbba681 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:35.058054 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3e77dfc-2e27-4a07-a034-71574fbba681 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:35.058515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3e77dfc-2e27-4a07-a034-71574fbba681 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:35.058946 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c3e77dfc-2e27-4a07-a034-71574fbba681 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:35.151267 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-022c8f63-689e-4c23-94ef-2c249d184e61 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:35.151906 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-022c8f63-689e-4c23-94ef-2c249d184e61 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:35.157885 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-022c8f63-689e-4c23-94ef-2c249d184e61 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:35.158302 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-022c8f63-689e-4c23-94ef-2c249d184e61 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:35.158736 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-022c8f63-689e-4c23-94ef-2c249d184e61 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:35.159702 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-022c8f63-689e-4c23-94ef-2c249d184e61 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:35.160532 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-022c8f63-689e-4c23-94ef-2c249d184e61 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:35.160958 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-022c8f63-689e-4c23-94ef-2c249d184e61 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:35.189169 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c3e77dfc-2e27-4a07-a034-71574fbba681 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:35.197356 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c3e77dfc-2e27-4a07-a034-71574fbba681 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.151615 Oct 06 12:23:35.197919 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 102/195] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:35 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:35.287535 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-022c8f63-689e-4c23-94ef-2c249d184e61 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:35.296306 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-022c8f63-689e-4c23-94ef-2c249d184e61 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.148936 Oct 06 12:23:35.296758 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 94/196] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:35 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:36.220330 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e5a6cae7-b7c5-4c96-a740-974354e6d534 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:36.220937 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e5a6cae7-b7c5-4c96-a740-974354e6d534 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:36.226720 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e5a6cae7-b7c5-4c96-a740-974354e6d534 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:36.227199 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e5a6cae7-b7c5-4c96-a740-974354e6d534 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:36.227671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e5a6cae7-b7c5-4c96-a740-974354e6d534 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:36.228344 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e5a6cae7-b7c5-4c96-a740-974354e6d534 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:36.228790 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e5a6cae7-b7c5-4c96-a740-974354e6d534 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:36.229211 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e5a6cae7-b7c5-4c96-a740-974354e6d534 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:36.317867 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f81eee64-5941-484c-801d-334c3ce17cf7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:36.318465 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f81eee64-5941-484c-801d-334c3ce17cf7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:36.324801 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f81eee64-5941-484c-801d-334c3ce17cf7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:36.325271 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f81eee64-5941-484c-801d-334c3ce17cf7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:36.325691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f81eee64-5941-484c-801d-334c3ce17cf7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:36.326362 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f81eee64-5941-484c-801d-334c3ce17cf7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:36.326803 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f81eee64-5941-484c-801d-334c3ce17cf7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:36.327218 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f81eee64-5941-484c-801d-334c3ce17cf7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:36.346186 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:36.352702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e5a6cae7-b7c5-4c96-a740-974354e6d534 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:36.360503 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e5a6cae7-b7c5-4c96-a740-974354e6d534 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.143944 Oct 06 12:23:36.371100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 103/197] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:36 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:36.457134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f81eee64-5941-484c-801d-334c3ce17cf7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:36.464983 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f81eee64-5941-484c-801d-334c3ce17cf7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.150802 Oct 06 12:23:36.465664 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 95/198] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:36 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:37.384319 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3221d2e7-2186-476e-a961-14e5f386a0eb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:37.384916 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3221d2e7-2186-476e-a961-14e5f386a0eb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:37.390608 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3221d2e7-2186-476e-a961-14e5f386a0eb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:37.391087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3221d2e7-2186-476e-a961-14e5f386a0eb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:37.391543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3221d2e7-2186-476e-a961-14e5f386a0eb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:37.392290 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3221d2e7-2186-476e-a961-14e5f386a0eb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:37.392852 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3221d2e7-2186-476e-a961-14e5f386a0eb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:37.393291 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3221d2e7-2186-476e-a961-14e5f386a0eb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:37.487718 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2ea6709c-0191-4256-aeec-103287cc3992 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:37.488327 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2ea6709c-0191-4256-aeec-103287cc3992 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:37.490137 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:37.497995 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2ea6709c-0191-4256-aeec-103287cc3992 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:37.498479 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2ea6709c-0191-4256-aeec-103287cc3992 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:37.498903 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2ea6709c-0191-4256-aeec-103287cc3992 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:37.499612 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2ea6709c-0191-4256-aeec-103287cc3992 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:37.500057 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2ea6709c-0191-4256-aeec-103287cc3992 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:37.500470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2ea6709c-0191-4256-aeec-103287cc3992 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:37.521792 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3221d2e7-2186-476e-a961-14e5f386a0eb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:37.529507 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3221d2e7-2186-476e-a961-14e5f386a0eb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.149642 Oct 06 12:23:37.530074 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 104/199] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:37 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:37.629627 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2ea6709c-0191-4256-aeec-103287cc3992 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:37.637157 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2ea6709c-0191-4256-aeec-103287cc3992 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.153276 Oct 06 12:23:37.637719 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 96/200] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:37 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:38.552344 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f9104a8b-15c8-40c2-859c-60adc8978b4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:38.552956 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f9104a8b-15c8-40c2-859c-60adc8978b4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:38.558783 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f9104a8b-15c8-40c2-859c-60adc8978b4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:38.559268 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f9104a8b-15c8-40c2-859c-60adc8978b4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:38.559745 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f9104a8b-15c8-40c2-859c-60adc8978b4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:38.560429 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f9104a8b-15c8-40c2-859c-60adc8978b4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:38.560885 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f9104a8b-15c8-40c2-859c-60adc8978b4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:38.561312 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f9104a8b-15c8-40c2-859c-60adc8978b4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:38.660041 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-42ea6ddf-3c83-45a8-aed0-753cf22c9c1d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:38.660543 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-42ea6ddf-3c83-45a8-aed0-753cf22c9c1d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:38.666312 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-42ea6ddf-3c83-45a8-aed0-753cf22c9c1d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:38.666783 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-42ea6ddf-3c83-45a8-aed0-753cf22c9c1d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:38.667207 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-42ea6ddf-3c83-45a8-aed0-753cf22c9c1d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:38.667908 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-42ea6ddf-3c83-45a8-aed0-753cf22c9c1d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:38.668349 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-42ea6ddf-3c83-45a8-aed0-753cf22c9c1d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:38.668760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-42ea6ddf-3c83-45a8-aed0-753cf22c9c1d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:38.687148 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f9104a8b-15c8-40c2-859c-60adc8978b4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:38.694689 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f9104a8b-15c8-40c2-859c-60adc8978b4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.146126 Oct 06 12:23:38.695253 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 105/201] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:38 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:38.791929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-42ea6ddf-3c83-45a8-aed0-753cf22c9c1d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:38.799411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-42ea6ddf-3c83-45a8-aed0-753cf22c9c1d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.143486 Oct 06 12:23:38.799980 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 97/202] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:38 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:39.717942 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ccdad5c0-9b86-48a2-8608-1ea579c99212 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:39.718549 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ccdad5c0-9b86-48a2-8608-1ea579c99212 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:39.724432 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ccdad5c0-9b86-48a2-8608-1ea579c99212 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:39.724945 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ccdad5c0-9b86-48a2-8608-1ea579c99212 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:39.725378 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ccdad5c0-9b86-48a2-8608-1ea579c99212 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:39.726054 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ccdad5c0-9b86-48a2-8608-1ea579c99212 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:39.726504 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ccdad5c0-9b86-48a2-8608-1ea579c99212 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:39.726926 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ccdad5c0-9b86-48a2-8608-1ea579c99212 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:39.822414 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4f8c52ed-26cb-4a7f-9134-c73833f3acb0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:39.823114 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4f8c52ed-26cb-4a7f-9134-c73833f3acb0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:39.828905 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4f8c52ed-26cb-4a7f-9134-c73833f3acb0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:39.829384 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4f8c52ed-26cb-4a7f-9134-c73833f3acb0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:39.829810 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4f8c52ed-26cb-4a7f-9134-c73833f3acb0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:39.830485 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4f8c52ed-26cb-4a7f-9134-c73833f3acb0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:39.830929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4f8c52ed-26cb-4a7f-9134-c73833f3acb0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:39.831342 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4f8c52ed-26cb-4a7f-9134-c73833f3acb0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:39.855030 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ccdad5c0-9b86-48a2-8608-1ea579c99212 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:39.862580 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ccdad5c0-9b86-48a2-8608-1ea579c99212 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.148438 Oct 06 12:23:39.863140 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 106/203] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:39 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:39.956234 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4f8c52ed-26cb-4a7f-9134-c73833f3acb0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:39.964197 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4f8c52ed-26cb-4a7f-9134-c73833f3acb0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.145401 Oct 06 12:23:39.964772 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 98/204] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:39 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:40.886455 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-427719b2-a8b8-4e04-8769-0c424afbef40 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:40.887072 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-427719b2-a8b8-4e04-8769-0c424afbef40 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:40.892943 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-427719b2-a8b8-4e04-8769-0c424afbef40 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:40.893429 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-427719b2-a8b8-4e04-8769-0c424afbef40 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:40.893866 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-427719b2-a8b8-4e04-8769-0c424afbef40 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:40.894552 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-427719b2-a8b8-4e04-8769-0c424afbef40 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:40.895008 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-427719b2-a8b8-4e04-8769-0c424afbef40 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:40.895433 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-427719b2-a8b8-4e04-8769-0c424afbef40 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:40.987893 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a54cf1ef-b2e4-4478-9f7c-67c1dd6a2da7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:40.988502 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a54cf1ef-b2e4-4478-9f7c-67c1dd6a2da7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:40.995312 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a54cf1ef-b2e4-4478-9f7c-67c1dd6a2da7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:40.995765 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a54cf1ef-b2e4-4478-9f7c-67c1dd6a2da7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:40.996194 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a54cf1ef-b2e4-4478-9f7c-67c1dd6a2da7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:40.996881 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a54cf1ef-b2e4-4478-9f7c-67c1dd6a2da7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:40.997312 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a54cf1ef-b2e4-4478-9f7c-67c1dd6a2da7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:40.997727 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a54cf1ef-b2e4-4478-9f7c-67c1dd6a2da7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:41.222284 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-427719b2-a8b8-4e04-8769-0c424afbef40 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:41.231354 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-427719b2-a8b8-4e04-8769-0c424afbef40 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.349217 Oct 06 12:23:41.232133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 107/205] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:40 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:41.266976 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a54cf1ef-b2e4-4478-9f7c-67c1dd6a2da7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:41.274580 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a54cf1ef-b2e4-4478-9f7c-67c1dd6a2da7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.290481 Oct 06 12:23:41.275140 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 99/206] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:40 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:42.253321 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-17c1ee80-d652-4ce5-ae57-d7a7c1dba023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:42.254725 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-17c1ee80-d652-4ce5-ae57-d7a7c1dba023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:42.260861 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17c1ee80-d652-4ce5-ae57-d7a7c1dba023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:42.261345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17c1ee80-d652-4ce5-ae57-d7a7c1dba023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:42.261779 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17c1ee80-d652-4ce5-ae57-d7a7c1dba023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:42.262631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17c1ee80-d652-4ce5-ae57-d7a7c1dba023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:42.263089 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17c1ee80-d652-4ce5-ae57-d7a7c1dba023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:42.263538 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17c1ee80-d652-4ce5-ae57-d7a7c1dba023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:42.297130 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0cebbdbe-4f25-470b-81bb-5156c1ebbe9b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:42.298258 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0cebbdbe-4f25-470b-81bb-5156c1ebbe9b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:42.304396 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0cebbdbe-4f25-470b-81bb-5156c1ebbe9b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:42.304877 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0cebbdbe-4f25-470b-81bb-5156c1ebbe9b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:42.305870 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0cebbdbe-4f25-470b-81bb-5156c1ebbe9b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:42.306769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0cebbdbe-4f25-470b-81bb-5156c1ebbe9b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:42.307216 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0cebbdbe-4f25-470b-81bb-5156c1ebbe9b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:42.307824 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0cebbdbe-4f25-470b-81bb-5156c1ebbe9b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:42.437410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-17c1ee80-d652-4ce5-ae57-d7a7c1dba023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:42.445002 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-17c1ee80-d652-4ce5-ae57-d7a7c1dba023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.195816 Oct 06 12:23:42.445585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 108/207] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:42 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:42.466985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0cebbdbe-4f25-470b-81bb-5156c1ebbe9b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:42.474761 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0cebbdbe-4f25-470b-81bb-5156c1ebbe9b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.181545 Oct 06 12:23:42.475323 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 100/208] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:42 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:43.468084 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-57bbec41-32e4-4502-a8c7-8da658a95b46 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:43.468647 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-57bbec41-32e4-4502-a8c7-8da658a95b46 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:43.474398 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-57bbec41-32e4-4502-a8c7-8da658a95b46 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:43.474882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-57bbec41-32e4-4502-a8c7-8da658a95b46 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:43.475315 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-57bbec41-32e4-4502-a8c7-8da658a95b46 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:43.476031 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-57bbec41-32e4-4502-a8c7-8da658a95b46 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:43.476485 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-57bbec41-32e4-4502-a8c7-8da658a95b46 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:43.477520 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-57bbec41-32e4-4502-a8c7-8da658a95b46 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:43.495187 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=100 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:43.497452 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2c12e55a-320f-461b-8358-704698409a88 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:43.498059 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2c12e55a-320f-461b-8358-704698409a88 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:43.504205 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c12e55a-320f-461b-8358-704698409a88 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:43.504695 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c12e55a-320f-461b-8358-704698409a88 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:43.505158 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c12e55a-320f-461b-8358-704698409a88 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:43.505850 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c12e55a-320f-461b-8358-704698409a88 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:43.506302 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c12e55a-320f-461b-8358-704698409a88 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:43.506731 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c12e55a-320f-461b-8358-704698409a88 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:43.670746 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-57bbec41-32e4-4502-a8c7-8da658a95b46 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:43.679322 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-57bbec41-32e4-4502-a8c7-8da658a95b46 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.215093 Oct 06 12:23:43.680013 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 109/209] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:43 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:43.695562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2c12e55a-320f-461b-8358-704698409a88 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:43.703224 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2c12e55a-320f-461b-8358-704698409a88 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.209687 Oct 06 12:23:43.703851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 101/210] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:43 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:44.219668 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f3220395-c45e-45a0-8b3e-41eb6db87016 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab52787b-f9ff-4588-a08f-b0e69abb6251"}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:23:44.222591 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f3220395-c45e-45a0-8b3e-41eb6db87016 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:44.230459 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3220395-c45e-45a0-8b3e-41eb6db87016 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:44.231127 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3220395-c45e-45a0-8b3e-41eb6db87016 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:44.231912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3220395-c45e-45a0-8b3e-41eb6db87016 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:44.232580 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3220395-c45e-45a0-8b3e-41eb6db87016 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:44.233037 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3220395-c45e-45a0-8b3e-41eb6db87016 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:44.233460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3220395-c45e-45a0-8b3e-41eb6db87016 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:44.706449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8e9b52cc-02e0-443b-963e-f6cd6d0c9932 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:44.707796 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8e9b52cc-02e0-443b-963e-f6cd6d0c9932 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:44.715966 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8e9b52cc-02e0-443b-963e-f6cd6d0c9932 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:44.716641 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8e9b52cc-02e0-443b-963e-f6cd6d0c9932 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:44.717068 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8e9b52cc-02e0-443b-963e-f6cd6d0c9932 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:44.718168 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8e9b52cc-02e0-443b-963e-f6cd6d0c9932 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:44.718943 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8e9b52cc-02e0-443b-963e-f6cd6d0c9932 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:44.719588 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8e9b52cc-02e0-443b-963e-f6cd6d0c9932 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:44.862440 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f3220395-c45e-45a0-8b3e-41eb6db87016 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "POST /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.644637 Oct 06 12:23:44.863241 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 110/211] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 12:23:44 2022] POST /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b/os-volume_attachments => generated 194 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:23:44.879015 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f4fb052b-4d66-43cd-b120-8d7509a9ca6e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:44.880424 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f4fb052b-4d66-43cd-b120-8d7509a9ca6e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:44.922092 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4fb052b-4d66-43cd-b120-8d7509a9ca6e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:44.922092 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4fb052b-4d66-43cd-b120-8d7509a9ca6e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:44.924177 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4fb052b-4d66-43cd-b120-8d7509a9ca6e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:44.925539 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4fb052b-4d66-43cd-b120-8d7509a9ca6e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:44.925752 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8e9b52cc-02e0-443b-963e-f6cd6d0c9932 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:44.926128 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4fb052b-4d66-43cd-b120-8d7509a9ca6e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:44.926664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4fb052b-4d66-43cd-b120-8d7509a9ca6e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:44.942509 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8e9b52cc-02e0-443b-963e-f6cd6d0c9932 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.240295 Oct 06 12:23:44.950623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 102/212] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:44 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:45.147374 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f4fb052b-4d66-43cd-b120-8d7509a9ca6e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:45.157742 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f4fb052b-4d66-43cd-b120-8d7509a9ca6e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.293079 Oct 06 12:23:45.167340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 111/213] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:44 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:45.969335 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-82f4494c-18bf-4e4e-88b7-27a0c8813a1f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:45.969939 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-82f4494c-18bf-4e4e-88b7-27a0c8813a1f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:45.975795 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-82f4494c-18bf-4e4e-88b7-27a0c8813a1f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:45.976278 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-82f4494c-18bf-4e4e-88b7-27a0c8813a1f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:45.976711 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-82f4494c-18bf-4e4e-88b7-27a0c8813a1f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:45.977392 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-82f4494c-18bf-4e4e-88b7-27a0c8813a1f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:45.977838 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-82f4494c-18bf-4e4e-88b7-27a0c8813a1f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:45.978259 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-82f4494c-18bf-4e4e-88b7-27a0c8813a1f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:46.105823 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-82f4494c-18bf-4e4e-88b7-27a0c8813a1f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:46.113425 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-82f4494c-18bf-4e4e-88b7-27a0c8813a1f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.147893 Oct 06 12:23:46.114025 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 103/214] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:45 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:46.181021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-63f2d5a3-cc57-4472-b9a1-e7cbeb450fbb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:46.181565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-63f2d5a3-cc57-4472-b9a1-e7cbeb450fbb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:46.188178 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63f2d5a3-cc57-4472-b9a1-e7cbeb450fbb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:46.188657 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63f2d5a3-cc57-4472-b9a1-e7cbeb450fbb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:46.189114 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63f2d5a3-cc57-4472-b9a1-e7cbeb450fbb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:46.189797 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63f2d5a3-cc57-4472-b9a1-e7cbeb450fbb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:46.190246 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63f2d5a3-cc57-4472-b9a1-e7cbeb450fbb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:46.190668 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63f2d5a3-cc57-4472-b9a1-e7cbeb450fbb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:46.316733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-63f2d5a3-cc57-4472-b9a1-e7cbeb450fbb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:46.324989 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-63f2d5a3-cc57-4472-b9a1-e7cbeb450fbb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.148385 Oct 06 12:23:46.325561 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 112/215] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:46 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:47.136610 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2b1fe653-64d1-4469-afdb-82be016947ff tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:47.137311 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2b1fe653-64d1-4469-afdb-82be016947ff tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:47.143264 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b1fe653-64d1-4469-afdb-82be016947ff tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:47.143776 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b1fe653-64d1-4469-afdb-82be016947ff tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:47.144202 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b1fe653-64d1-4469-afdb-82be016947ff tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:47.144871 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b1fe653-64d1-4469-afdb-82be016947ff tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:47.145314 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b1fe653-64d1-4469-afdb-82be016947ff tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:47.145727 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b1fe653-64d1-4469-afdb-82be016947ff tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:47.273049 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2b1fe653-64d1-4469-afdb-82be016947ff tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:47.281464 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2b1fe653-64d1-4469-afdb-82be016947ff tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.148762 Oct 06 12:23:47.282019 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 104/216] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:47 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:47.347675 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c18ef046-0e05-4b40-8e80-545a8f58036a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:47.348279 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c18ef046-0e05-4b40-8e80-545a8f58036a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:47.354463 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c18ef046-0e05-4b40-8e80-545a8f58036a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:47.354936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c18ef046-0e05-4b40-8e80-545a8f58036a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:47.355363 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c18ef046-0e05-4b40-8e80-545a8f58036a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:47.356069 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c18ef046-0e05-4b40-8e80-545a8f58036a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:47.356598 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c18ef046-0e05-4b40-8e80-545a8f58036a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:47.357022 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c18ef046-0e05-4b40-8e80-545a8f58036a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:47.488062 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c18ef046-0e05-4b40-8e80-545a8f58036a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:47.495575 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c18ef046-0e05-4b40-8e80-545a8f58036a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.151659 Oct 06 12:23:47.496147 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 113/217] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:47 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:48.304401 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-555af212-052d-4de9-b2e2-d33ee8c92ac9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:48.305507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-555af212-052d-4de9-b2e2-d33ee8c92ac9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:48.311345 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-555af212-052d-4de9-b2e2-d33ee8c92ac9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:48.311856 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-555af212-052d-4de9-b2e2-d33ee8c92ac9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:48.312281 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-555af212-052d-4de9-b2e2-d33ee8c92ac9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:48.312951 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-555af212-052d-4de9-b2e2-d33ee8c92ac9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:48.313392 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-555af212-052d-4de9-b2e2-d33ee8c92ac9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:48.313810 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-555af212-052d-4de9-b2e2-d33ee8c92ac9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:48.441380 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-555af212-052d-4de9-b2e2-d33ee8c92ac9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:48.449221 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-555af212-052d-4de9-b2e2-d33ee8c92ac9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.148660 Oct 06 12:23:48.449775 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 105/218] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:48 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:48.518281 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3d37aafb-fa31-438e-af8e-ef7327b7b45d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:48.518889 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3d37aafb-fa31-438e-af8e-ef7327b7b45d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:48.525181 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3d37aafb-fa31-438e-af8e-ef7327b7b45d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:48.525656 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3d37aafb-fa31-438e-af8e-ef7327b7b45d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:48.526086 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3d37aafb-fa31-438e-af8e-ef7327b7b45d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:48.526798 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3d37aafb-fa31-438e-af8e-ef7327b7b45d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:48.527253 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3d37aafb-fa31-438e-af8e-ef7327b7b45d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:48.527705 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3d37aafb-fa31-438e-af8e-ef7327b7b45d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:48.653861 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3d37aafb-fa31-438e-af8e-ef7327b7b45d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:48.661711 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3d37aafb-fa31-438e-af8e-ef7327b7b45d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.147323 Oct 06 12:23:48.662280 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 114/219] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:48 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:49.472636 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e628e6df-abc4-48a8-b3b1-1889d1bf06ef tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:49.473241 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e628e6df-abc4-48a8-b3b1-1889d1bf06ef tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:49.475074 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=66 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:49.481073 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e628e6df-abc4-48a8-b3b1-1889d1bf06ef tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:49.481559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e628e6df-abc4-48a8-b3b1-1889d1bf06ef tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:49.482021 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e628e6df-abc4-48a8-b3b1-1889d1bf06ef tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:49.482709 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e628e6df-abc4-48a8-b3b1-1889d1bf06ef tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:49.483157 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e628e6df-abc4-48a8-b3b1-1889d1bf06ef tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:49.483601 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e628e6df-abc4-48a8-b3b1-1889d1bf06ef tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:49.606957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e628e6df-abc4-48a8-b3b1-1889d1bf06ef tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:49.614517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e628e6df-abc4-48a8-b3b1-1889d1bf06ef tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.145777 Oct 06 12:23:49.615089 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 106/220] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:49 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:49.683932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-67de0f13-bacd-4fa4-bcce-09a831fb034d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:49.684533 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-67de0f13-bacd-4fa4-bcce-09a831fb034d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:49.690873 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67de0f13-bacd-4fa4-bcce-09a831fb034d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:49.691352 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67de0f13-bacd-4fa4-bcce-09a831fb034d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:49.691820 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67de0f13-bacd-4fa4-bcce-09a831fb034d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:49.692500 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67de0f13-bacd-4fa4-bcce-09a831fb034d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:49.692953 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67de0f13-bacd-4fa4-bcce-09a831fb034d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:49.693375 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67de0f13-bacd-4fa4-bcce-09a831fb034d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:49.830927 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-67de0f13-bacd-4fa4-bcce-09a831fb034d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:49.840940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-67de0f13-bacd-4fa4-bcce-09a831fb034d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.160701 Oct 06 12:23:49.841518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 115/221] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:49 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:50.637456 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5f6fe718-0a9e-4f10-ab38-e84292fbdbcb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:50.638062 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5f6fe718-0a9e-4f10-ab38-e84292fbdbcb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:50.643865 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5f6fe718-0a9e-4f10-ab38-e84292fbdbcb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:50.644332 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5f6fe718-0a9e-4f10-ab38-e84292fbdbcb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:50.644756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5f6fe718-0a9e-4f10-ab38-e84292fbdbcb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:50.645424 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5f6fe718-0a9e-4f10-ab38-e84292fbdbcb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:50.645895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5f6fe718-0a9e-4f10-ab38-e84292fbdbcb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:50.646309 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5f6fe718-0a9e-4f10-ab38-e84292fbdbcb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:50.772441 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5f6fe718-0a9e-4f10-ab38-e84292fbdbcb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:50.780738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5f6fe718-0a9e-4f10-ab38-e84292fbdbcb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.147217 Oct 06 12:23:50.781303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 107/222] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:50 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:50.864581 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-abd65211-f0de-4050-8f0b-084ef257023c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:50.865218 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-abd65211-f0de-4050-8f0b-084ef257023c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:50.871650 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-abd65211-f0de-4050-8f0b-084ef257023c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:50.872135 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-abd65211-f0de-4050-8f0b-084ef257023c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:50.872567 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-abd65211-f0de-4050-8f0b-084ef257023c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:50.873256 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-abd65211-f0de-4050-8f0b-084ef257023c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:50.873711 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-abd65211-f0de-4050-8f0b-084ef257023c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:50.874211 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-abd65211-f0de-4050-8f0b-084ef257023c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:51.009566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-abd65211-f0de-4050-8f0b-084ef257023c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:51.017192 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-abd65211-f0de-4050-8f0b-084ef257023c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.156420 Oct 06 12:23:51.017763 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 116/223] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:50 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:51.804418 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c6d4d82c-7a74-4357-b47a-69f5e3c7a1af tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:51.805004 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c6d4d82c-7a74-4357-b47a-69f5e3c7a1af tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:51.811018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6d4d82c-7a74-4357-b47a-69f5e3c7a1af tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:51.811515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6d4d82c-7a74-4357-b47a-69f5e3c7a1af tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:51.811961 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6d4d82c-7a74-4357-b47a-69f5e3c7a1af tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:51.812646 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6d4d82c-7a74-4357-b47a-69f5e3c7a1af tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:51.813094 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6d4d82c-7a74-4357-b47a-69f5e3c7a1af tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:51.813514 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6d4d82c-7a74-4357-b47a-69f5e3c7a1af tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:51.951650 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c6d4d82c-7a74-4357-b47a-69f5e3c7a1af tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:51.959435 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c6d4d82c-7a74-4357-b47a-69f5e3c7a1af tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.158905 Oct 06 12:23:51.967550 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 108/224] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:51 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:52.042948 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b9dda732-4fa4-44a7-9e8e-0df16da07d05 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:52.044286 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b9dda732-4fa4-44a7-9e8e-0df16da07d05 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:52.051890 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9dda732-4fa4-44a7-9e8e-0df16da07d05 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:52.052593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9dda732-4fa4-44a7-9e8e-0df16da07d05 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:52.053098 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9dda732-4fa4-44a7-9e8e-0df16da07d05 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:52.053946 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9dda732-4fa4-44a7-9e8e-0df16da07d05 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:52.054492 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9dda732-4fa4-44a7-9e8e-0df16da07d05 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:52.055192 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9dda732-4fa4-44a7-9e8e-0df16da07d05 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:52.233735 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b9dda732-4fa4-44a7-9e8e-0df16da07d05 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:52.247628 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b9dda732-4fa4-44a7-9e8e-0df16da07d05 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.208921 Oct 06 12:23:52.248727 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 117/225] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:52 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:52.452723 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-25f08ee0-dc87-4a64-95ca-b703f34c3b14 req-66eaeee2-59dc-45ed-9e63-bb7bb5974b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c26e82-69b3-4ffa-97e2-7ca36b941c1f", "name": "network-vif-plugged", "status": "completed", "tag": "2f5ac9b9-0c5c-4565-96ae-3de71a11dddd"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:23:52.468219 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-25f08ee0-dc87-4a64-95ca-b703f34c3b14 req-66eaeee2-59dc-45ed-9e63-bb7bb5974b3c service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:52.468921 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-25f08ee0-dc87-4a64-95ca-b703f34c3b14 req-66eaeee2-59dc-45ed-9e63-bb7bb5974b3c service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:52.470402 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-25f08ee0-dc87-4a64-95ca-b703f34c3b14 req-66eaeee2-59dc-45ed-9e63-bb7bb5974b3c service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:52.500145 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-25f08ee0-dc87-4a64-95ca-b703f34c3b14 req-66eaeee2-59dc-45ed-9e63-bb7bb5974b3c service nova] Creating event network-vif-plugged:2f5ac9b9-0c5c-4565-96ae-3de71a11dddd for instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f on hv-cinder-85604 Oct 06 12:23:52.521298 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-25f08ee0-dc87-4a64-95ca-b703f34c3b14 req-66eaeee2-59dc-45ed-9e63-bb7bb5974b3c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073817 Oct 06 12:23:52.521298 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 109/226] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:23:52.983588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8a1ecd99-19ee-407e-8405-dc11ed2ecc9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:52.984211 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8a1ecd99-19ee-407e-8405-dc11ed2ecc9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:52.990633 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a1ecd99-19ee-407e-8405-dc11ed2ecc9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:52.991127 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a1ecd99-19ee-407e-8405-dc11ed2ecc9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:52.991594 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a1ecd99-19ee-407e-8405-dc11ed2ecc9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:52.992937 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a1ecd99-19ee-407e-8405-dc11ed2ecc9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:52.993560 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a1ecd99-19ee-407e-8405-dc11ed2ecc9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:52.994144 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a1ecd99-19ee-407e-8405-dc11ed2ecc9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:53.199120 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8a1ecd99-19ee-407e-8405-dc11ed2ecc9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:53.206997 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8a1ecd99-19ee-407e-8405-dc11ed2ecc9a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.227296 Oct 06 12:23:53.207733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 118/227] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:52 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:53.272435 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ff6f1167-9530-42c2-8fa7-cba7eade655b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:53.274400 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ff6f1167-9530-42c2-8fa7-cba7eade655b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:53.282175 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff6f1167-9530-42c2-8fa7-cba7eade655b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:53.282787 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff6f1167-9530-42c2-8fa7-cba7eade655b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:53.283223 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff6f1167-9530-42c2-8fa7-cba7eade655b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:53.284220 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff6f1167-9530-42c2-8fa7-cba7eade655b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:53.284646 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff6f1167-9530-42c2-8fa7-cba7eade655b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:53.285329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff6f1167-9530-42c2-8fa7-cba7eade655b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:53.462570 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ff6f1167-9530-42c2-8fa7-cba7eade655b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:53.477270 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ff6f1167-9530-42c2-8fa7-cba7eade655b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.210450 Oct 06 12:23:53.479546 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 110/228] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:53 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:54.232650 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e8236828-e781-4240-976f-76c9b0bf683a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:54.233349 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e8236828-e781-4240-976f-76c9b0bf683a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:54.246007 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=62 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:54.253826 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e8236828-e781-4240-976f-76c9b0bf683a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:54.255111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e8236828-e781-4240-976f-76c9b0bf683a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:54.255641 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e8236828-e781-4240-976f-76c9b0bf683a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:54.259401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e8236828-e781-4240-976f-76c9b0bf683a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:54.259936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e8236828-e781-4240-976f-76c9b0bf683a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:54.260696 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e8236828-e781-4240-976f-76c9b0bf683a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:54.502637 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ce7a71f5-8a31-4631-89e4-72695583b477 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:54.503949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ce7a71f5-8a31-4631-89e4-72695583b477 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:54.515366 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce7a71f5-8a31-4631-89e4-72695583b477 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:54.517571 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce7a71f5-8a31-4631-89e4-72695583b477 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:54.522576 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e8236828-e781-4240-976f-76c9b0bf683a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:54.528991 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce7a71f5-8a31-4631-89e4-72695583b477 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:54.536173 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e8236828-e781-4240-976f-76c9b0bf683a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1363 microversion: 2.1 time: 0.308990 Oct 06 12:23:54.537070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce7a71f5-8a31-4631-89e4-72695583b477 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:54.537866 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce7a71f5-8a31-4631-89e4-72695583b477 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:54.544536 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 119/229] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:54 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:54.544913 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ce7a71f5-8a31-4631-89e4-72695583b477 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:54.732937 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ce7a71f5-8a31-4631-89e4-72695583b477 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:54.749124 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ce7a71f5-8a31-4631-89e4-72695583b477 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.250316 Oct 06 12:23:54.751224 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 111/230] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:54 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:55.572772 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b9c359a3-04ac-4bde-b14a-485bc3fb0cde tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:55.574778 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b9c359a3-04ac-4bde-b14a-485bc3fb0cde tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:55.581582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9c359a3-04ac-4bde-b14a-485bc3fb0cde tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:55.582239 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9c359a3-04ac-4bde-b14a-485bc3fb0cde tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:55.582682 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9c359a3-04ac-4bde-b14a-485bc3fb0cde tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:55.583377 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9c359a3-04ac-4bde-b14a-485bc3fb0cde tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:55.583871 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9c359a3-04ac-4bde-b14a-485bc3fb0cde tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:55.584299 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9c359a3-04ac-4bde-b14a-485bc3fb0cde tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:55.774885 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b9c359a3-04ac-4bde-b14a-485bc3fb0cde tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:55.783182 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d0ba321f-d27e-4435-8476-c82184cf05dc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:55.784706 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d0ba321f-d27e-4435-8476-c82184cf05dc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:55.792273 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d0ba321f-d27e-4435-8476-c82184cf05dc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:55.793648 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d0ba321f-d27e-4435-8476-c82184cf05dc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:55.794276 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d0ba321f-d27e-4435-8476-c82184cf05dc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:55.795152 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d0ba321f-d27e-4435-8476-c82184cf05dc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:55.795910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d0ba321f-d27e-4435-8476-c82184cf05dc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:55.796493 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d0ba321f-d27e-4435-8476-c82184cf05dc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:55.807986 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b9c359a3-04ac-4bde-b14a-485bc3fb0cde tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1549 microversion: 2.1 time: 0.241125 Oct 06 12:23:55.809228 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 120/231] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:55 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1549 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:55.834291 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5f8166e1-eb3b-49e6-91b0-8ee03f74c108 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:55.834840 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5f8166e1-eb3b-49e6-91b0-8ee03f74c108 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:55.845407 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f8166e1-eb3b-49e6-91b0-8ee03f74c108 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:55.846396 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f8166e1-eb3b-49e6-91b0-8ee03f74c108 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:55.847667 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f8166e1-eb3b-49e6-91b0-8ee03f74c108 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:55.848928 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f8166e1-eb3b-49e6-91b0-8ee03f74c108 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:55.849630 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f8166e1-eb3b-49e6-91b0-8ee03f74c108 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:55.850366 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f8166e1-eb3b-49e6-91b0-8ee03f74c108 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:56.016587 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5f8166e1-eb3b-49e6-91b0-8ee03f74c108 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185878 Oct 06 12:23:56.018045 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 121/232] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 12:23:55 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/os-interface => generated 284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:23:56.056866 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d0ba321f-d27e-4435-8476-c82184cf05dc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:56.065490 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=100 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:56.068596 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d0ba321f-d27e-4435-8476-c82184cf05dc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.289271 Oct 06 12:23:56.083370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 112/233] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:55 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:23:57.099641 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-358bf899-3019-40a5-b6ba-212cdc27ac65 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:57.101711 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-358bf899-3019-40a5-b6ba-212cdc27ac65 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:57.113000 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-358bf899-3019-40a5-b6ba-212cdc27ac65 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:57.113739 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-358bf899-3019-40a5-b6ba-212cdc27ac65 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:57.114414 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-358bf899-3019-40a5-b6ba-212cdc27ac65 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:57.115371 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-358bf899-3019-40a5-b6ba-212cdc27ac65 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:57.116204 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-358bf899-3019-40a5-b6ba-212cdc27ac65 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:57.117442 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-358bf899-3019-40a5-b6ba-212cdc27ac65 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:57.293171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-358bf899-3019-40a5-b6ba-212cdc27ac65 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:57.304091 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-358bf899-3019-40a5-b6ba-212cdc27ac65 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.211219 Oct 06 12:23:57.305406 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 122/234] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:57 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:57.554731 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-437bb997-cff4-4e58-ba19-afb688be1aed req-1fc10a73-5279-4f6f-9b50-55a4a33bb655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7c26e82-69b3-4ffa-97e2-7ca36b941c1f", "tag": "2f5ac9b9-0c5c-4565-96ae-3de71a11dddd"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:23:57.573421 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-437bb997-cff4-4e58-ba19-afb688be1aed req-1fc10a73-5279-4f6f-9b50-55a4a33bb655 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:57.573912 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-437bb997-cff4-4e58-ba19-afb688be1aed req-1fc10a73-5279-4f6f-9b50-55a4a33bb655 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:57.574575 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-437bb997-cff4-4e58-ba19-afb688be1aed req-1fc10a73-5279-4f6f-9b50-55a4a33bb655 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:57.592889 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-437bb997-cff4-4e58-ba19-afb688be1aed req-1fc10a73-5279-4f6f-9b50-55a4a33bb655 service nova] Creating event network-changed:2f5ac9b9-0c5c-4565-96ae-3de71a11dddd for instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f on hv-cinder-85604 Oct 06 12:23:57.599833 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-437bb997-cff4-4e58-ba19-afb688be1aed req-1fc10a73-5279-4f6f-9b50-55a4a33bb655 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050357 Oct 06 12:23:57.600626 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 113/235] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:23:58.328462 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-bd7da40d-682c-4c6f-8d8e-cd188c05e536 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:58.329753 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-bd7da40d-682c-4c6f-8d8e-cd188c05e536 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:58.342198 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bd7da40d-682c-4c6f-8d8e-cd188c05e536 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:58.342704 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bd7da40d-682c-4c6f-8d8e-cd188c05e536 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:58.343326 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bd7da40d-682c-4c6f-8d8e-cd188c05e536 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:58.344186 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bd7da40d-682c-4c6f-8d8e-cd188c05e536 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:58.346825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bd7da40d-682c-4c6f-8d8e-cd188c05e536 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:58.347283 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bd7da40d-682c-4c6f-8d8e-cd188c05e536 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:58.546136 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-bd7da40d-682c-4c6f-8d8e-cd188c05e536 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:58.558382 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-bd7da40d-682c-4c6f-8d8e-cd188c05e536 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.233902 Oct 06 12:23:58.559266 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 123/236] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:58 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:23:59.584618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-05ef4699-42c5-4901-aedb-125da3a9b8a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:23:59.585909 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-05ef4699-42c5-4901-aedb-125da3a9b8a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:23:59.594111 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-05ef4699-42c5-4901-aedb-125da3a9b8a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:59.594684 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-05ef4699-42c5-4901-aedb-125da3a9b8a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:59.595548 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-05ef4699-42c5-4901-aedb-125da3a9b8a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:59.597671 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-05ef4699-42c5-4901-aedb-125da3a9b8a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:23:59.598429 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-05ef4699-42c5-4901-aedb-125da3a9b8a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:23:59.599571 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-05ef4699-42c5-4901-aedb-125da3a9b8a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:23:59.795061 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-05ef4699-42c5-4901-aedb-125da3a9b8a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:23:59.805826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-05ef4699-42c5-4901-aedb-125da3a9b8a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.225013 Oct 06 12:23:59.806408 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 114/237] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:23:59 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:00.828720 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2ee78611-ce6a-424b-8831-183123c3ae42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:00.829383 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2ee78611-ce6a-424b-8831-183123c3ae42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:00.836394 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2ee78611-ce6a-424b-8831-183123c3ae42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:00.836879 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2ee78611-ce6a-424b-8831-183123c3ae42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:00.837314 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2ee78611-ce6a-424b-8831-183123c3ae42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:00.838004 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2ee78611-ce6a-424b-8831-183123c3ae42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:00.838458 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2ee78611-ce6a-424b-8831-183123c3ae42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:00.838884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2ee78611-ce6a-424b-8831-183123c3ae42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:00.969358 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2ee78611-ce6a-424b-8831-183123c3ae42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:00.977193 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2ee78611-ce6a-424b-8831-183123c3ae42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.152436 Oct 06 12:24:00.977757 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 124/238] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:00 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:02.000313 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ff1ee1be-a0db-451f-87ea-e9c423f4adbe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:02.000947 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ff1ee1be-a0db-451f-87ea-e9c423f4adbe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:02.006996 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff1ee1be-a0db-451f-87ea-e9c423f4adbe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:02.008184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff1ee1be-a0db-451f-87ea-e9c423f4adbe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:02.008625 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff1ee1be-a0db-451f-87ea-e9c423f4adbe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:02.009346 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff1ee1be-a0db-451f-87ea-e9c423f4adbe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:02.009793 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff1ee1be-a0db-451f-87ea-e9c423f4adbe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:02.010214 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ff1ee1be-a0db-451f-87ea-e9c423f4adbe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:02.141730 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ff1ee1be-a0db-451f-87ea-e9c423f4adbe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:02.150115 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ff1ee1be-a0db-451f-87ea-e9c423f4adbe tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.153644 Oct 06 12:24:02.150688 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 115/239] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:01 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:03.172932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-68f0b68e-66fd-449c-98d9-18d325827560 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:03.173558 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-68f0b68e-66fd-449c-98d9-18d325827560 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:03.180408 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-68f0b68e-66fd-449c-98d9-18d325827560 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:03.180887 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-68f0b68e-66fd-449c-98d9-18d325827560 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:03.181313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-68f0b68e-66fd-449c-98d9-18d325827560 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:03.181987 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-68f0b68e-66fd-449c-98d9-18d325827560 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:03.182434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-68f0b68e-66fd-449c-98d9-18d325827560 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:03.182855 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-68f0b68e-66fd-449c-98d9-18d325827560 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:03.186739 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:03.311041 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-68f0b68e-66fd-449c-98d9-18d325827560 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:03.318570 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-68f0b68e-66fd-449c-98d9-18d325827560 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.149461 Oct 06 12:24:03.319136 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 125/240] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:03 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:04.341453 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-28fdfa4e-6820-4b7f-91be-98a9f13772ce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:04.341983 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-28fdfa4e-6820-4b7f-91be-98a9f13772ce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:04.347839 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-28fdfa4e-6820-4b7f-91be-98a9f13772ce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:04.348313 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-28fdfa4e-6820-4b7f-91be-98a9f13772ce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:04.348738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-28fdfa4e-6820-4b7f-91be-98a9f13772ce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:04.349405 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-28fdfa4e-6820-4b7f-91be-98a9f13772ce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:04.349846 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-28fdfa4e-6820-4b7f-91be-98a9f13772ce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:04.350259 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-28fdfa4e-6820-4b7f-91be-98a9f13772ce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:04.474274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-28fdfa4e-6820-4b7f-91be-98a9f13772ce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:04.482311 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-28fdfa4e-6820-4b7f-91be-98a9f13772ce tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.144791 Oct 06 12:24:04.482867 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 116/241] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:04 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:05.505468 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-bfd8581f-533f-4fb3-94e3-b98b276757f3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:05.505999 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-bfd8581f-533f-4fb3-94e3-b98b276757f3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:05.513072 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bfd8581f-533f-4fb3-94e3-b98b276757f3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:05.513551 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bfd8581f-533f-4fb3-94e3-b98b276757f3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:05.513985 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bfd8581f-533f-4fb3-94e3-b98b276757f3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:05.514667 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bfd8581f-533f-4fb3-94e3-b98b276757f3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:05.515118 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bfd8581f-533f-4fb3-94e3-b98b276757f3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:05.515559 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bfd8581f-533f-4fb3-94e3-b98b276757f3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:05.646393 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-bfd8581f-533f-4fb3-94e3-b98b276757f3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:05.654628 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-bfd8581f-533f-4fb3-94e3-b98b276757f3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.153069 Oct 06 12:24:05.655404 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 126/242] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:05 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:06.677766 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0fcdda1f-5b30-4af6-88b3-b2cc4f8b6386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:06.678375 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0fcdda1f-5b30-4af6-88b3-b2cc4f8b6386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:06.685138 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0fcdda1f-5b30-4af6-88b3-b2cc4f8b6386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:06.685625 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0fcdda1f-5b30-4af6-88b3-b2cc4f8b6386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:06.686059 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0fcdda1f-5b30-4af6-88b3-b2cc4f8b6386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:06.686739 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0fcdda1f-5b30-4af6-88b3-b2cc4f8b6386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:06.687184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0fcdda1f-5b30-4af6-88b3-b2cc4f8b6386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:06.687656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0fcdda1f-5b30-4af6-88b3-b2cc4f8b6386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:06.823011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0fcdda1f-5b30-4af6-88b3-b2cc4f8b6386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:06.830559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0fcdda1f-5b30-4af6-88b3-b2cc4f8b6386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.156672 Oct 06 12:24:06.831124 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 117/243] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:06 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:07.852952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7e90c365-474f-42ed-ab21-9504a613151c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:07.853561 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7e90c365-474f-42ed-ab21-9504a613151c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:07.859946 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e90c365-474f-42ed-ab21-9504a613151c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:07.860431 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e90c365-474f-42ed-ab21-9504a613151c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:07.860866 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e90c365-474f-42ed-ab21-9504a613151c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:07.861551 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e90c365-474f-42ed-ab21-9504a613151c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:07.862000 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e90c365-474f-42ed-ab21-9504a613151c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:07.862421 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e90c365-474f-42ed-ab21-9504a613151c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:07.997153 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7e90c365-474f-42ed-ab21-9504a613151c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:08.004884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7e90c365-474f-42ed-ab21-9504a613151c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.155782 Oct 06 12:24:08.005458 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 127/244] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:07 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:09.028167 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-6c716e4a-cb6c-461a-8ef1-c9759dd400ed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:09.028763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-6c716e4a-cb6c-461a-8ef1-c9759dd400ed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:09.035184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c716e4a-cb6c-461a-8ef1-c9759dd400ed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:09.035751 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c716e4a-cb6c-461a-8ef1-c9759dd400ed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:09.036317 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c716e4a-cb6c-461a-8ef1-c9759dd400ed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:09.037099 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c716e4a-cb6c-461a-8ef1-c9759dd400ed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:09.037785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c716e4a-cb6c-461a-8ef1-c9759dd400ed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:09.038795 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c716e4a-cb6c-461a-8ef1-c9759dd400ed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:09.243753 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-6c716e4a-cb6c-461a-8ef1-c9759dd400ed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:09.253212 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-6c716e4a-cb6c-461a-8ef1-c9759dd400ed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.228711 Oct 06 12:24:09.254314 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 118/245] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:09 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:09.917507 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5e28d368-118c-4f0a-a595-81b1411aa758 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:09.918009 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5e28d368-118c-4f0a-a595-81b1411aa758 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:09.924528 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5e28d368-118c-4f0a-a595-81b1411aa758 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:09.924904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5e28d368-118c-4f0a-a595-81b1411aa758 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:09.925339 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5e28d368-118c-4f0a-a595-81b1411aa758 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:09.926033 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5e28d368-118c-4f0a-a595-81b1411aa758 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:09.926489 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5e28d368-118c-4f0a-a595-81b1411aa758 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:09.926915 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5e28d368-118c-4f0a-a595-81b1411aa758 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:09.955879 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5e28d368-118c-4f0a-a595-81b1411aa758 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Going to try to terminate instance {{(pid=120508) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:24:10.058502 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5e28d368-118c-4f0a-a595-81b1411aa758 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "DELETE /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 204 len: 0 microversion: 2.1 time: 0.145084 Oct 06 12:24:10.063077 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 128/246] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:24:09 2022] DELETE /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:24:10.068467 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5f7648e9-ce3b-46a1-a1b5-4b4286dbfd61 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:10.069077 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5f7648e9-ce3b-46a1-a1b5-4b4286dbfd61 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:10.075061 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5f7648e9-ce3b-46a1-a1b5-4b4286dbfd61 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:10.075816 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5f7648e9-ce3b-46a1-a1b5-4b4286dbfd61 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:10.076253 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5f7648e9-ce3b-46a1-a1b5-4b4286dbfd61 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:10.076950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5f7648e9-ce3b-46a1-a1b5-4b4286dbfd61 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:10.077407 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5f7648e9-ce3b-46a1-a1b5-4b4286dbfd61 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:10.084040 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5f7648e9-ce3b-46a1-a1b5-4b4286dbfd61 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:10.220358 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5f7648e9-ce3b-46a1-a1b5-4b4286dbfd61 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:10.229172 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5f7648e9-ce3b-46a1-a1b5-4b4286dbfd61 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1552 microversion: 2.1 time: 0.164799 Oct 06 12:24:10.229738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 119/247] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:10 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:10.280226 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7c85c880-50e9-416d-b32e-d154355a1c18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:10.280964 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7c85c880-50e9-416d-b32e-d154355a1c18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:10.287404 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7c85c880-50e9-416d-b32e-d154355a1c18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:10.287925 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7c85c880-50e9-416d-b32e-d154355a1c18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:10.288361 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7c85c880-50e9-416d-b32e-d154355a1c18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:10.289229 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7c85c880-50e9-416d-b32e-d154355a1c18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:10.289910 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7c85c880-50e9-416d-b32e-d154355a1c18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:10.290867 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7c85c880-50e9-416d-b32e-d154355a1c18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:10.431013 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7c85c880-50e9-416d-b32e-d154355a1c18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:10.439533 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7c85c880-50e9-416d-b32e-d154355a1c18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.164095 Oct 06 12:24:10.440612 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 129/248] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:10 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:11.256340 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4866e47d-fe03-4dfd-9125-054977179785 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:11.256954 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4866e47d-fe03-4dfd-9125-054977179785 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:11.263655 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4866e47d-fe03-4dfd-9125-054977179785 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:11.264160 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4866e47d-fe03-4dfd-9125-054977179785 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:11.264584 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4866e47d-fe03-4dfd-9125-054977179785 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:11.265287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4866e47d-fe03-4dfd-9125-054977179785 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:11.265728 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4866e47d-fe03-4dfd-9125-054977179785 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:11.266141 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4866e47d-fe03-4dfd-9125-054977179785 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:11.390273 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4866e47d-fe03-4dfd-9125-054977179785 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:11.398384 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4866e47d-fe03-4dfd-9125-054977179785 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1552 microversion: 2.1 time: 0.145927 Oct 06 12:24:11.398951 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 120/249] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:11 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1552 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:11.467662 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f7a932c6-6919-448d-8e19-dac78586eb71 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:11.468270 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f7a932c6-6919-448d-8e19-dac78586eb71 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:11.474568 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7a932c6-6919-448d-8e19-dac78586eb71 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:11.475050 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7a932c6-6919-448d-8e19-dac78586eb71 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:11.475480 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7a932c6-6919-448d-8e19-dac78586eb71 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:11.476183 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7a932c6-6919-448d-8e19-dac78586eb71 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:11.476647 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7a932c6-6919-448d-8e19-dac78586eb71 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:11.477057 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7a932c6-6919-448d-8e19-dac78586eb71 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:11.757758 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f7a932c6-6919-448d-8e19-dac78586eb71 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:11.766231 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f7a932c6-6919-448d-8e19-dac78586eb71 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.302412 Oct 06 12:24:11.766870 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 130/250] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:11 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:12.421722 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3a0250aa-aa0d-4a88-9da9-7414a37c21ce tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:12.422345 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3a0250aa-aa0d-4a88-9da9-7414a37c21ce tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:12.428318 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3a0250aa-aa0d-4a88-9da9-7414a37c21ce tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:12.428798 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3a0250aa-aa0d-4a88-9da9-7414a37c21ce tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:12.429228 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3a0250aa-aa0d-4a88-9da9-7414a37c21ce tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:12.429903 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3a0250aa-aa0d-4a88-9da9-7414a37c21ce tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:12.430865 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3a0250aa-aa0d-4a88-9da9-7414a37c21ce tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:12.431284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3a0250aa-aa0d-4a88-9da9-7414a37c21ce tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:12.553866 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3a0250aa-aa0d-4a88-9da9-7414a37c21ce tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:12.562399 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3a0250aa-aa0d-4a88-9da9-7414a37c21ce tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1552 microversion: 2.1 time: 0.144548 Oct 06 12:24:12.562963 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 121/251] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:12 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1552 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:12.792966 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f54188db-7780-4061-8a67-c700c75f1775 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:12.793677 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f54188db-7780-4061-8a67-c700c75f1775 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:12.800960 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f54188db-7780-4061-8a67-c700c75f1775 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:12.801500 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f54188db-7780-4061-8a67-c700c75f1775 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:12.802136 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f54188db-7780-4061-8a67-c700c75f1775 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:12.802860 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f54188db-7780-4061-8a67-c700c75f1775 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:12.803327 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f54188db-7780-4061-8a67-c700c75f1775 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:12.803864 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f54188db-7780-4061-8a67-c700c75f1775 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:12.963616 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f54188db-7780-4061-8a67-c700c75f1775 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:12.972265 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f54188db-7780-4061-8a67-c700c75f1775 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.186045 Oct 06 12:24:12.972935 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 131/252] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:12 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:13.585612 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-87328bd5-d612-4a59-ac70-8acc3596f391 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:13.586215 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-87328bd5-d612-4a59-ac70-8acc3596f391 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:13.592087 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-87328bd5-d612-4a59-ac70-8acc3596f391 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:13.592568 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-87328bd5-d612-4a59-ac70-8acc3596f391 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:13.593003 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-87328bd5-d612-4a59-ac70-8acc3596f391 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:13.593679 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-87328bd5-d612-4a59-ac70-8acc3596f391 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:13.594128 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-87328bd5-d612-4a59-ac70-8acc3596f391 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:13.594550 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-87328bd5-d612-4a59-ac70-8acc3596f391 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:13.718023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-87328bd5-d612-4a59-ac70-8acc3596f391 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:13.726040 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-87328bd5-d612-4a59-ac70-8acc3596f391 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1552 microversion: 2.1 time: 0.144265 Oct 06 12:24:13.726608 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 122/253] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:13 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1552 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:13.995830 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-920da690-3b18-485d-8f8f-21e7805c88a6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:13.996432 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-920da690-3b18-485d-8f8f-21e7805c88a6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:14.002603 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-920da690-3b18-485d-8f8f-21e7805c88a6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:14.003083 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-920da690-3b18-485d-8f8f-21e7805c88a6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:14.003529 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-920da690-3b18-485d-8f8f-21e7805c88a6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:14.004216 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-920da690-3b18-485d-8f8f-21e7805c88a6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:14.004668 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-920da690-3b18-485d-8f8f-21e7805c88a6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:14.005085 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-920da690-3b18-485d-8f8f-21e7805c88a6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:14.142973 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-920da690-3b18-485d-8f8f-21e7805c88a6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:14.151128 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-920da690-3b18-485d-8f8f-21e7805c88a6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.159518 Oct 06 12:24:14.151752 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 132/254] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:13 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:14.749761 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e845a3a1-84c7-4917-a371-62dbfb1d24c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:14.750294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e845a3a1-84c7-4917-a371-62dbfb1d24c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:14.756274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e845a3a1-84c7-4917-a371-62dbfb1d24c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:14.756751 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e845a3a1-84c7-4917-a371-62dbfb1d24c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:14.757179 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e845a3a1-84c7-4917-a371-62dbfb1d24c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:14.757850 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e845a3a1-84c7-4917-a371-62dbfb1d24c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:14.758299 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e845a3a1-84c7-4917-a371-62dbfb1d24c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:14.759291 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e845a3a1-84c7-4917-a371-62dbfb1d24c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:14.887535 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e845a3a1-84c7-4917-a371-62dbfb1d24c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:14.895986 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e845a3a1-84c7-4917-a371-62dbfb1d24c4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1552 microversion: 2.1 time: 0.150032 Oct 06 12:24:14.896560 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 123/255] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:14 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:15.173940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7a6655c4-2a42-429e-8147-3b8b9aadb77c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:15.174552 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7a6655c4-2a42-429e-8147-3b8b9aadb77c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:15.181122 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7a6655c4-2a42-429e-8147-3b8b9aadb77c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:15.181618 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7a6655c4-2a42-429e-8147-3b8b9aadb77c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:15.182037 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7a6655c4-2a42-429e-8147-3b8b9aadb77c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:15.182725 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7a6655c4-2a42-429e-8147-3b8b9aadb77c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:15.183178 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7a6655c4-2a42-429e-8147-3b8b9aadb77c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:15.183628 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7a6655c4-2a42-429e-8147-3b8b9aadb77c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:15.306689 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7a6655c4-2a42-429e-8147-3b8b9aadb77c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:15.314251 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7a6655c4-2a42-429e-8147-3b8b9aadb77c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.144119 Oct 06 12:24:15.314826 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 133/256] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:15 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:15.917848 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b73d5004-9fce-4a6b-823b-087297c2644b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:15.918458 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b73d5004-9fce-4a6b-823b-087297c2644b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:15.924423 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b73d5004-9fce-4a6b-823b-087297c2644b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:15.924895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b73d5004-9fce-4a6b-823b-087297c2644b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:15.925322 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b73d5004-9fce-4a6b-823b-087297c2644b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:15.926007 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b73d5004-9fce-4a6b-823b-087297c2644b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:15.926437 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b73d5004-9fce-4a6b-823b-087297c2644b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:15.926856 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b73d5004-9fce-4a6b-823b-087297c2644b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:16.056813 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b73d5004-9fce-4a6b-823b-087297c2644b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:16.064863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b73d5004-9fce-4a6b-823b-087297c2644b tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1552 microversion: 2.1 time: 0.150834 Oct 06 12:24:16.065425 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 124/257] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:15 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:16.336764 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-eb3c88ed-f4ef-4561-b596-feabe937af23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:16.337414 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-eb3c88ed-f4ef-4561-b596-feabe937af23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:16.343982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eb3c88ed-f4ef-4561-b596-feabe937af23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:16.344469 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eb3c88ed-f4ef-4561-b596-feabe937af23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:16.344907 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eb3c88ed-f4ef-4561-b596-feabe937af23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:16.345599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eb3c88ed-f4ef-4561-b596-feabe937af23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:16.346057 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eb3c88ed-f4ef-4561-b596-feabe937af23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:16.346484 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eb3c88ed-f4ef-4561-b596-feabe937af23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:16.472315 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-eb3c88ed-f4ef-4561-b596-feabe937af23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:16.480015 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-eb3c88ed-f4ef-4561-b596-feabe937af23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.147676 Oct 06 12:24:16.480584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 134/258] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:16 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:24:17.088161 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-abc65544-e04f-461e-9353-5ff68566ee76 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:17.088737 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-abc65544-e04f-461e-9353-5ff68566ee76 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:17.094651 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-abc65544-e04f-461e-9353-5ff68566ee76 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:17.095122 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-abc65544-e04f-461e-9353-5ff68566ee76 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:17.095566 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-abc65544-e04f-461e-9353-5ff68566ee76 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:17.096234 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-abc65544-e04f-461e-9353-5ff68566ee76 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:17.096674 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-abc65544-e04f-461e-9353-5ff68566ee76 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:17.097086 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-abc65544-e04f-461e-9353-5ff68566ee76 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:17.298162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-abc65544-e04f-461e-9353-5ff68566ee76 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:17.311244 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-abc65544-e04f-461e-9353-5ff68566ee76 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1552 microversion: 2.1 time: 0.226885 Oct 06 12:24:17.311877 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 125/259] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:17 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1552 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:24:17.502360 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a230a820-12fd-41b2-bec4-67322f96e3b4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:17.502963 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a230a820-12fd-41b2-bec4-67322f96e3b4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:17.509678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a230a820-12fd-41b2-bec4-67322f96e3b4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:17.510154 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a230a820-12fd-41b2-bec4-67322f96e3b4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:17.510579 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a230a820-12fd-41b2-bec4-67322f96e3b4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:17.511254 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a230a820-12fd-41b2-bec4-67322f96e3b4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:17.511734 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a230a820-12fd-41b2-bec4-67322f96e3b4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:17.512161 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a230a820-12fd-41b2-bec4-67322f96e3b4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:17.643988 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a230a820-12fd-41b2-bec4-67322f96e3b4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:17.652225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a230a820-12fd-41b2-bec4-67322f96e3b4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.153640 Oct 06 12:24:17.652982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 135/260] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:17 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:18.334580 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-00668b70-434c-49a4-a59b-9ff8fe42cde4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:18.335332 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-00668b70-434c-49a4-a59b-9ff8fe42cde4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:18.342795 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-00668b70-434c-49a4-a59b-9ff8fe42cde4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:18.343393 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-00668b70-434c-49a4-a59b-9ff8fe42cde4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:18.344025 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-00668b70-434c-49a4-a59b-9ff8fe42cde4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:18.344770 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-00668b70-434c-49a4-a59b-9ff8fe42cde4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:18.345349 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-00668b70-434c-49a4-a59b-9ff8fe42cde4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:18.345989 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-00668b70-434c-49a4-a59b-9ff8fe42cde4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:18.485220 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-00668b70-434c-49a4-a59b-9ff8fe42cde4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:18.494276 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-00668b70-434c-49a4-a59b-9ff8fe42cde4 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1552 microversion: 2.1 time: 0.164130 Oct 06 12:24:18.494850 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 126/261] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:18 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:18.676361 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a5ac2418-9a32-4b79-8ebc-408fdc0941bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:18.677492 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a5ac2418-9a32-4b79-8ebc-408fdc0941bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:18.684923 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5ac2418-9a32-4b79-8ebc-408fdc0941bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:18.685410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5ac2418-9a32-4b79-8ebc-408fdc0941bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:18.685843 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5ac2418-9a32-4b79-8ebc-408fdc0941bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:18.686538 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5ac2418-9a32-4b79-8ebc-408fdc0941bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:18.686993 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5ac2418-9a32-4b79-8ebc-408fdc0941bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:18.687417 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5ac2418-9a32-4b79-8ebc-408fdc0941bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:18.833497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a5ac2418-9a32-4b79-8ebc-408fdc0941bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:18.841745 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a5ac2418-9a32-4b79-8ebc-408fdc0941bf tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.170295 Oct 06 12:24:18.842308 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 136/262] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:18 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:19.518150 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-88f4bc40-eb2d-48da-b783-d6fe25b94673 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:19.518750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-88f4bc40-eb2d-48da-b783-d6fe25b94673 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:19.520693 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=42 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:19.526382 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88f4bc40-eb2d-48da-b783-d6fe25b94673 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:19.526858 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88f4bc40-eb2d-48da-b783-d6fe25b94673 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:19.527290 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88f4bc40-eb2d-48da-b783-d6fe25b94673 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:19.527996 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88f4bc40-eb2d-48da-b783-d6fe25b94673 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:19.528445 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88f4bc40-eb2d-48da-b783-d6fe25b94673 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:19.528856 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88f4bc40-eb2d-48da-b783-d6fe25b94673 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:19.653176 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-88f4bc40-eb2d-48da-b783-d6fe25b94673 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:19.661561 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-88f4bc40-eb2d-48da-b783-d6fe25b94673 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1552 microversion: 2.1 time: 0.147231 Oct 06 12:24:19.662126 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 127/263] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:19 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:19.863846 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c6e9928c-ee0c-4967-ba7a-98a600e5b100 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:19.864456 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c6e9928c-ee0c-4967-ba7a-98a600e5b100 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:19.870816 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6e9928c-ee0c-4967-ba7a-98a600e5b100 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:19.871299 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6e9928c-ee0c-4967-ba7a-98a600e5b100 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:19.871790 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6e9928c-ee0c-4967-ba7a-98a600e5b100 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:19.872476 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6e9928c-ee0c-4967-ba7a-98a600e5b100 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:19.872931 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6e9928c-ee0c-4967-ba7a-98a600e5b100 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:19.873354 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6e9928c-ee0c-4967-ba7a-98a600e5b100 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:20.002081 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c6e9928c-ee0c-4967-ba7a-98a600e5b100 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:20.009770 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c6e9928c-ee0c-4967-ba7a-98a600e5b100 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.149708 Oct 06 12:24:20.010337 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 137/264] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:19 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:20.684587 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b0f17b47-a7db-4b9f-8547-60360a83e4ae tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:20.685200 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b0f17b47-a7db-4b9f-8547-60360a83e4ae tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:20.691071 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b0f17b47-a7db-4b9f-8547-60360a83e4ae tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:20.691574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b0f17b47-a7db-4b9f-8547-60360a83e4ae tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:20.692005 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b0f17b47-a7db-4b9f-8547-60360a83e4ae tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:20.692686 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b0f17b47-a7db-4b9f-8547-60360a83e4ae tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:20.693133 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b0f17b47-a7db-4b9f-8547-60360a83e4ae tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:20.693552 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b0f17b47-a7db-4b9f-8547-60360a83e4ae tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:20.822334 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b0f17b47-a7db-4b9f-8547-60360a83e4ae tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:20.830402 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b0f17b47-a7db-4b9f-8547-60360a83e4ae tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1552 microversion: 2.1 time: 0.149701 Oct 06 12:24:20.830961 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 128/265] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:20 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:21.033124 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-67ff92f4-bc7d-4234-951c-8ab323dc136f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:21.033722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-67ff92f4-bc7d-4234-951c-8ab323dc136f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:21.040899 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67ff92f4-bc7d-4234-951c-8ab323dc136f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:21.041387 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67ff92f4-bc7d-4234-951c-8ab323dc136f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:21.041823 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67ff92f4-bc7d-4234-951c-8ab323dc136f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:21.042530 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67ff92f4-bc7d-4234-951c-8ab323dc136f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:21.042984 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67ff92f4-bc7d-4234-951c-8ab323dc136f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:21.043406 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67ff92f4-bc7d-4234-951c-8ab323dc136f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:21.169276 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-67ff92f4-bc7d-4234-951c-8ab323dc136f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:21.176885 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-67ff92f4-bc7d-4234-951c-8ab323dc136f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.147838 Oct 06 12:24:21.177451 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 138/266] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:21 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:21.853806 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9e452b0e-16bd-41a0-be0c-faabd5a0e808 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:21.854494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9e452b0e-16bd-41a0-be0c-faabd5a0e808 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:21.860616 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e452b0e-16bd-41a0-be0c-faabd5a0e808 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:21.861084 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e452b0e-16bd-41a0-be0c-faabd5a0e808 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:21.861508 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e452b0e-16bd-41a0-be0c-faabd5a0e808 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:21.862177 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e452b0e-16bd-41a0-be0c-faabd5a0e808 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:21.862619 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e452b0e-16bd-41a0-be0c-faabd5a0e808 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:21.863032 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e452b0e-16bd-41a0-be0c-faabd5a0e808 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:21.994916 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9e452b0e-16bd-41a0-be0c-faabd5a0e808 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:22.002952 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9e452b0e-16bd-41a0-be0c-faabd5a0e808 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1552 microversion: 2.1 time: 0.153533 Oct 06 12:24:22.003533 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 129/267] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:21 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:22.200723 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7e6d9dc7-bb62-48b9-8d4a-c552f97a1386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:22.201319 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7e6d9dc7-bb62-48b9-8d4a-c552f97a1386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:22.207829 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e6d9dc7-bb62-48b9-8d4a-c552f97a1386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:22.208306 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e6d9dc7-bb62-48b9-8d4a-c552f97a1386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:22.208735 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e6d9dc7-bb62-48b9-8d4a-c552f97a1386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:22.209410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e6d9dc7-bb62-48b9-8d4a-c552f97a1386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:22.209858 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e6d9dc7-bb62-48b9-8d4a-c552f97a1386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:22.210274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e6d9dc7-bb62-48b9-8d4a-c552f97a1386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:22.338399 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7e6d9dc7-bb62-48b9-8d4a-c552f97a1386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:22.345919 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7e6d9dc7-bb62-48b9-8d4a-c552f97a1386 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.149101 Oct 06 12:24:22.346474 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 139/268] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:22 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:23.027441 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-12bbd309-af1d-43fa-ad7f-3e5aa27eb355 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:23.028069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-12bbd309-af1d-43fa-ad7f-3e5aa27eb355 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:23.034466 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-12bbd309-af1d-43fa-ad7f-3e5aa27eb355 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:23.034940 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-12bbd309-af1d-43fa-ad7f-3e5aa27eb355 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:23.035385 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-12bbd309-af1d-43fa-ad7f-3e5aa27eb355 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:23.036088 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-12bbd309-af1d-43fa-ad7f-3e5aa27eb355 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:23.036658 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-12bbd309-af1d-43fa-ad7f-3e5aa27eb355 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:23.037305 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-12bbd309-af1d-43fa-ad7f-3e5aa27eb355 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:23.041983 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=100 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:23.164495 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-12bbd309-af1d-43fa-ad7f-3e5aa27eb355 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:23.172582 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-12bbd309-af1d-43fa-ad7f-3e5aa27eb355 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1552 microversion: 2.1 time: 0.149276 Oct 06 12:24:23.173142 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 130/269] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:23 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:23.368741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5f59a23c-41f0-4655-987e-e38da170ad81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:23.369399 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5f59a23c-41f0-4655-987e-e38da170ad81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:23.375698 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f59a23c-41f0-4655-987e-e38da170ad81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:23.376183 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f59a23c-41f0-4655-987e-e38da170ad81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:23.376614 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f59a23c-41f0-4655-987e-e38da170ad81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:23.377302 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f59a23c-41f0-4655-987e-e38da170ad81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:23.378006 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f59a23c-41f0-4655-987e-e38da170ad81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:23.378437 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5f59a23c-41f0-4655-987e-e38da170ad81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:23.382426 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:23.506600 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5f59a23c-41f0-4655-987e-e38da170ad81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:23.514101 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5f59a23c-41f0-4655-987e-e38da170ad81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.149826 Oct 06 12:24:23.514665 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 140/270] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:23 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:24.196438 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-1c2d7cca-4559-474b-a248-b402ac3f7539 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:24.197036 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-1c2d7cca-4559-474b-a248-b402ac3f7539 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:24.202782 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1c2d7cca-4559-474b-a248-b402ac3f7539 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:24.203253 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1c2d7cca-4559-474b-a248-b402ac3f7539 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:24.203711 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1c2d7cca-4559-474b-a248-b402ac3f7539 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:24.204382 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1c2d7cca-4559-474b-a248-b402ac3f7539 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:24.204826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1c2d7cca-4559-474b-a248-b402ac3f7539 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:24.205239 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1c2d7cca-4559-474b-a248-b402ac3f7539 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:24.330536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-1c2d7cca-4559-474b-a248-b402ac3f7539 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:24.338632 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-1c2d7cca-4559-474b-a248-b402ac3f7539 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1552 microversion: 2.1 time: 0.146547 Oct 06 12:24:24.339201 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 131/271] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:24 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:24.536753 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a479f279-1459-4366-a0c2-af42cada09c4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:24.537386 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a479f279-1459-4366-a0c2-af42cada09c4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:24.539677 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:24.544777 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a479f279-1459-4366-a0c2-af42cada09c4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:24.545251 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a479f279-1459-4366-a0c2-af42cada09c4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:24.545678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a479f279-1459-4366-a0c2-af42cada09c4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:24.546356 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a479f279-1459-4366-a0c2-af42cada09c4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:24.546805 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a479f279-1459-4366-a0c2-af42cada09c4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:24.547226 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a479f279-1459-4366-a0c2-af42cada09c4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:24.677234 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a479f279-1459-4366-a0c2-af42cada09c4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:24.685895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a479f279-1459-4366-a0c2-af42cada09c4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1522 microversion: 2.1 time: 0.153089 Oct 06 12:24:24.686471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 141/272] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:24 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:25.362011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0a97c97c-af66-4aa2-bb38-849cb148bc8d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:25.362617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0a97c97c-af66-4aa2-bb38-849cb148bc8d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:25.368589 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0a97c97c-af66-4aa2-bb38-849cb148bc8d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:25.369064 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0a97c97c-af66-4aa2-bb38-849cb148bc8d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:25.369545 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0a97c97c-af66-4aa2-bb38-849cb148bc8d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:25.370276 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0a97c97c-af66-4aa2-bb38-849cb148bc8d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:25.370726 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0a97c97c-af66-4aa2-bb38-849cb148bc8d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:25.371145 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0a97c97c-af66-4aa2-bb38-849cb148bc8d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:25.505832 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0a97c97c-af66-4aa2-bb38-849cb148bc8d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:25.514450 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0a97c97c-af66-4aa2-bb38-849cb148bc8d tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1552 microversion: 2.1 time: 0.156748 Oct 06 12:24:25.515019 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 132/273] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:25 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:25.708757 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1e42cf82-c85e-4da1-af34-c9b3de47a6fd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:25.709372 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-1e42cf82-c85e-4da1-af34-c9b3de47a6fd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:25.716316 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1e42cf82-c85e-4da1-af34-c9b3de47a6fd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:25.716802 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1e42cf82-c85e-4da1-af34-c9b3de47a6fd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:25.717243 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1e42cf82-c85e-4da1-af34-c9b3de47a6fd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:25.717936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1e42cf82-c85e-4da1-af34-c9b3de47a6fd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:25.718391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1e42cf82-c85e-4da1-af34-c9b3de47a6fd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:25.718817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1e42cf82-c85e-4da1-af34-c9b3de47a6fd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:25.847252 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-1e42cf82-c85e-4da1-af34-c9b3de47a6fd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:25.855105 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-1e42cf82-c85e-4da1-af34-c9b3de47a6fd tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1502 microversion: 2.1 time: 0.150167 Oct 06 12:24:25.855720 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 142/274] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:25 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:25.878190 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-6b1a83c0-8cfc-402e-a908-3d1bcc8f79ee tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:25.878977 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-6b1a83c0-8cfc-402e-a908-3d1bcc8f79ee tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:25.885743 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6b1a83c0-8cfc-402e-a908-3d1bcc8f79ee tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:25.886241 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6b1a83c0-8cfc-402e-a908-3d1bcc8f79ee tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:25.886747 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6b1a83c0-8cfc-402e-a908-3d1bcc8f79ee tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:25.887478 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6b1a83c0-8cfc-402e-a908-3d1bcc8f79ee tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:25.888265 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6b1a83c0-8cfc-402e-a908-3d1bcc8f79ee tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:25.888687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6b1a83c0-8cfc-402e-a908-3d1bcc8f79ee tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:26.022244 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-6b1a83c0-8cfc-402e-a908-3d1bcc8f79ee tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:26.031723 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-6b1a83c0-8cfc-402e-a908-3d1bcc8f79ee tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1515 microversion: 2.1 time: 0.157441 Oct 06 12:24:26.032292 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 133/275] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:25 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:26.537947 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8e5e9094-9cd3-4fa7-a69d-7db6da656a73 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:26.538763 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8e5e9094-9cd3-4fa7-a69d-7db6da656a73 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:26.544601 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e5e9094-9cd3-4fa7-a69d-7db6da656a73 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:26.545084 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e5e9094-9cd3-4fa7-a69d-7db6da656a73 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:26.545515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e5e9094-9cd3-4fa7-a69d-7db6da656a73 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:26.546198 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e5e9094-9cd3-4fa7-a69d-7db6da656a73 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:26.546646 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e5e9094-9cd3-4fa7-a69d-7db6da656a73 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:26.547065 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e5e9094-9cd3-4fa7-a69d-7db6da656a73 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:26.727200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8e5e9094-9cd3-4fa7-a69d-7db6da656a73 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:26.736727 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8e5e9094-9cd3-4fa7-a69d-7db6da656a73 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1552 microversion: 2.1 time: 0.202438 Oct 06 12:24:26.754426 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 143/276] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:26 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1552 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:27.417298 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-0c3c6a81-c9e0-4b00-a86a-6a7144c8faff req-42d26510-26d2-4182-919a-e6f1d59b97f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "518de8e1-7379-4cc4-98da-0f042318420b", "name": "network-vif-deleted", "tag": "b3316e74-8f06-454a-ad05-4f9d36155fe9"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:24:27.429185 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-0c3c6a81-c9e0-4b00-a86a-6a7144c8faff req-42d26510-26d2-4182-919a-e6f1d59b97f1 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:27.430282 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-0c3c6a81-c9e0-4b00-a86a-6a7144c8faff req-42d26510-26d2-4182-919a-e6f1d59b97f1 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:27.431064 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-0c3c6a81-c9e0-4b00-a86a-6a7144c8faff req-42d26510-26d2-4182-919a-e6f1d59b97f1 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:27.446051 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-0c3c6a81-c9e0-4b00-a86a-6a7144c8faff req-42d26510-26d2-4182-919a-e6f1d59b97f1 service nova] Creating event network-vif-deleted:b3316e74-8f06-454a-ad05-4f9d36155fe9 for instance 518de8e1-7379-4cc4-98da-0f042318420b on hv-cinder-85604 Oct 06 12:24:27.453729 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-0c3c6a81-c9e0-4b00-a86a-6a7144c8faff req-42d26510-26d2-4182-919a-e6f1d59b97f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047318 Oct 06 12:24:27.454648 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 134/277] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:24:27.760536 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d2f1e07b-6d6d-4ec7-aaa2-dfec3dfff44c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:27.761213 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d2f1e07b-6d6d-4ec7-aaa2-dfec3dfff44c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:27.768731 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d2f1e07b-6d6d-4ec7-aaa2-dfec3dfff44c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:27.769207 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d2f1e07b-6d6d-4ec7-aaa2-dfec3dfff44c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:27.769636 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d2f1e07b-6d6d-4ec7-aaa2-dfec3dfff44c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:27.770313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d2f1e07b-6d6d-4ec7-aaa2-dfec3dfff44c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:27.770761 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d2f1e07b-6d6d-4ec7-aaa2-dfec3dfff44c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:27.771181 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d2f1e07b-6d6d-4ec7-aaa2-dfec3dfff44c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:27.832759 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d2f1e07b-6d6d-4ec7-aaa2-dfec3dfff44c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:27.841279 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d2f1e07b-6d6d-4ec7-aaa2-dfec3dfff44c tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1345 microversion: 2.1 time: 0.084608 Oct 06 12:24:27.841834 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 144/278] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:27 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:28.526839 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c2f24de9-18b3-4473-ba24-c691de4b9d9d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:24:28.529211 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c2f24de9-18b3-4473-ba24-c691de4b9d9d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:28.535519 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2f24de9-18b3-4473-ba24-c691de4b9d9d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:28.536012 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2f24de9-18b3-4473-ba24-c691de4b9d9d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:28.536439 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2f24de9-18b3-4473-ba24-c691de4b9d9d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:28.537113 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2f24de9-18b3-4473-ba24-c691de4b9d9d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:28.537558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2f24de9-18b3-4473-ba24-c691de4b9d9d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:28.537973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2f24de9-18b3-4473-ba24-c691de4b9d9d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:28.559965 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-c2f24de9-18b3-4473-ba24-c691de4b9d9d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lazy-loading 'flavor' on Instance uuid 6bdd2944-b97f-40e0-a1cb-915cea031265 {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:24:28.631496 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c2f24de9-18b3-4473-ba24-c691de4b9d9d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "POST /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265/action" status: 200 len: 32 microversion: 2.1 time: 0.109496 Oct 06 12:24:28.632114 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 135/279] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 12:24:28 2022] POST /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265/action => generated 32 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:24:28.642118 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d8156eb2-dbb9-4498-ac4f-d60b247057da tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:28.642733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d8156eb2-dbb9-4498-ac4f-d60b247057da tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:28.649127 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8156eb2-dbb9-4498-ac4f-d60b247057da tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:28.649613 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8156eb2-dbb9-4498-ac4f-d60b247057da tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:28.650286 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8156eb2-dbb9-4498-ac4f-d60b247057da tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:28.650994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8156eb2-dbb9-4498-ac4f-d60b247057da tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:28.651454 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8156eb2-dbb9-4498-ac4f-d60b247057da tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:28.651912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8156eb2-dbb9-4498-ac4f-d60b247057da tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:28.777405 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d8156eb2-dbb9-4498-ac4f-d60b247057da tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:28.785590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d8156eb2-dbb9-4498-ac4f-d60b247057da tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.147253 Oct 06 12:24:28.786266 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 145/280] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:28 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:28.864242 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-93e3e2ea-16b3-4d6c-a760-fd9f15425312 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:28.864934 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-93e3e2ea-16b3-4d6c-a760-fd9f15425312 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:28.870929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-93e3e2ea-16b3-4d6c-a760-fd9f15425312 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:28.871403 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-93e3e2ea-16b3-4d6c-a760-fd9f15425312 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:28.871866 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-93e3e2ea-16b3-4d6c-a760-fd9f15425312 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:28.872549 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-93e3e2ea-16b3-4d6c-a760-fd9f15425312 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:28.872999 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-93e3e2ea-16b3-4d6c-a760-fd9f15425312 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:28.873418 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-93e3e2ea-16b3-4d6c-a760-fd9f15425312 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:28.938180 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-93e3e2ea-16b3-4d6c-a760-fd9f15425312 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:28.946362 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-93e3e2ea-16b3-4d6c-a760-fd9f15425312 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1345 microversion: 2.1 time: 0.086524 Oct 06 12:24:28.959528 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 136/281] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:28 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:29.809691 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ced7851b-f7a5-40bb-9811-a1836e2e354e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:29.810298 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ced7851b-f7a5-40bb-9811-a1836e2e354e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:29.816516 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ced7851b-f7a5-40bb-9811-a1836e2e354e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:29.817007 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ced7851b-f7a5-40bb-9811-a1836e2e354e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:29.817421 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ced7851b-f7a5-40bb-9811-a1836e2e354e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:29.818096 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ced7851b-f7a5-40bb-9811-a1836e2e354e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:29.818543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ced7851b-f7a5-40bb-9811-a1836e2e354e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:29.818967 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ced7851b-f7a5-40bb-9811-a1836e2e354e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:29.949415 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ced7851b-f7a5-40bb-9811-a1836e2e354e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:29.957044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ced7851b-f7a5-40bb-9811-a1836e2e354e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.151172 Oct 06 12:24:29.957604 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 146/282] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:29 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:29.969945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-36113806-5b49-4b74-8422-17651395f463 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:29.970572 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-36113806-5b49-4b74-8422-17651395f463 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:29.976864 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36113806-5b49-4b74-8422-17651395f463 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:29.977340 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36113806-5b49-4b74-8422-17651395f463 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:29.977772 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36113806-5b49-4b74-8422-17651395f463 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:29.978443 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36113806-5b49-4b74-8422-17651395f463 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:29.978890 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36113806-5b49-4b74-8422-17651395f463 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:29.979353 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36113806-5b49-4b74-8422-17651395f463 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:30.008788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36113806-5b49-4b74-8422-17651395f463 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:30.009192 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36113806-5b49-4b74-8422-17651395f463 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:30.009617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36113806-5b49-4b74-8422-17651395f463 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:30.010050 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-36113806-5b49-4b74-8422-17651395f463 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lazy-loading 'fault' on Instance uuid 518de8e1-7379-4cc4-98da-0f042318420b {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:24:30.057354 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-36113806-5b49-4b74-8422-17651395f463 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d196263d2c49f88b5f81acb2586bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2acb456bc4aaeae1ff0927195aba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:30.065504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-36113806-5b49-4b74-8422-17651395f463 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 200 len: 1350 microversion: 2.1 time: 0.099342 Oct 06 12:24:30.066073 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 137/283] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:29 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:30.983419 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e09bcc9e-845d-486c-901e-4e5fcdcd9e82 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:30.984388 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e09bcc9e-845d-486c-901e-4e5fcdcd9e82 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:30.993444 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e09bcc9e-845d-486c-901e-4e5fcdcd9e82 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:30.994313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e09bcc9e-845d-486c-901e-4e5fcdcd9e82 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:30.994756 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e09bcc9e-845d-486c-901e-4e5fcdcd9e82 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:30.995537 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e09bcc9e-845d-486c-901e-4e5fcdcd9e82 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:30.996159 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e09bcc9e-845d-486c-901e-4e5fcdcd9e82 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:30.996597 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e09bcc9e-845d-486c-901e-4e5fcdcd9e82 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:31.089757 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9e8fec45-e5f9-4513-b07d-4408f5122597 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:31.091187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9e8fec45-e5f9-4513-b07d-4408f5122597 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:31.104097 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e8fec45-e5f9-4513-b07d-4408f5122597 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:31.104610 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e8fec45-e5f9-4513-b07d-4408f5122597 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:31.107272 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e8fec45-e5f9-4513-b07d-4408f5122597 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:31.109352 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e8fec45-e5f9-4513-b07d-4408f5122597 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:31.111234 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e8fec45-e5f9-4513-b07d-4408f5122597 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:31.112679 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e8fec45-e5f9-4513-b07d-4408f5122597 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:31.145278 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-9e8fec45-e5f9-4513-b07d-4408f5122597 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] HTTP exception thrown: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9e8fec45-e5f9-4513-b07d-4408f5122597 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Request method failure captured: Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b HTTP/1.1 Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsiCRv6EsDg5STS9N350yKEL1PB84XTCp5VMU8IDJ-jB6IdO8M2Y4gIEyjePN_-i7TiRdk196RlCNFjTGI_wK3u5OAxFG8LWQhyJFI44_Gn98WAWzEeEdZGi2srudn8qfUFSt7VSL02NjOulLAZxv5oEabTW1EAYUpodfB2-cY5fDXw Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 69d2acb456bc4aaeae1ff0927195aba2 Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-DeleteServersTestJSON-629737943 Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:24:31.152255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:24:31.153830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69d2acb456bc4aaeae1ff0927195aba2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_69d2acb456bc4aaeae1ff0927195aba2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69d2acb456bc4aaeae1ff0927195aba2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/69d2acb456bc4aaeae1ff0927195aba2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:24:31.153830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-DeleteServersTestJSON-629737943 Oct 06 12:24:31.153830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 69d2acb456bc4aaeae1ff0927195aba2 Oct 06 12:24:31.153830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-DeleteServersTestJSON-629737943 Oct 06 12:24:31.153830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-DeleteServersTestJSON-629737943-project Oct 06 12:24:31.153830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:24:31.153830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:24:31.153830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 18d196263d2c49f88b5f81acb2586bc1 Oct 06 12:24:31.153830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-DeleteServersTestJSON-629737943-project Oct 06 12:24:31.153830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:24:31.153830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:31.153830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '518de8e1-7379-4cc4-98da-0f042318420b'} Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:24:31.154985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:31.156687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:31.159626 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9e8fec45-e5f9-4513-b07d-4408f5122597 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Returning 404 to user: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:24:31.159626 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9e8fec45-e5f9-4513-b07d-4408f5122597 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 404 len: 111 microversion: 2.1 time: 0.073936 Oct 06 12:24:31.160455 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 138/284] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:31 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:24:31.251586 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e09bcc9e-845d-486c-901e-4e5fcdcd9e82 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:31.266516 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e09bcc9e-845d-486c-901e-4e5fcdcd9e82 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.290540 Oct 06 12:24:31.267353 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 147/285] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:30 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:31.314374 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f62687d4-6e7d-42fe-9f43-6b88138c994f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:31.317219 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f62687d4-6e7d-42fe-9f43-6b88138c994f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:31.323546 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f62687d4-6e7d-42fe-9f43-6b88138c994f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:31.324028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f62687d4-6e7d-42fe-9f43-6b88138c994f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:31.324746 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f62687d4-6e7d-42fe-9f43-6b88138c994f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:31.325605 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f62687d4-6e7d-42fe-9f43-6b88138c994f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:31.326192 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f62687d4-6e7d-42fe-9f43-6b88138c994f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:31.326642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f62687d4-6e7d-42fe-9f43-6b88138c994f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:31.345341 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-f62687d4-6e7d-42fe-9f43-6b88138c994f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] HTTP exception thrown: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f62687d4-6e7d-42fe-9f43-6b88138c994f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Request method failure captured: Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b/os-volume_attachments HTTP/1.1 Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsiCRv6EsDg5STS9N350yKEL1PB84XTCp5VMU8IDJ-jB6IdO8M2Y4gIEyjePN_-i7TiRdk196RlCNFjTGI_wK3u5OAxFG8LWQhyJFI44_Gn98WAWzEeEdZGi2srudn8qfUFSt7VSL02NjOulLAZxv5oEabTW1EAYUpodfB2-cY5fDXw Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 69d2acb456bc4aaeae1ff0927195aba2 Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-DeleteServersTestJSON-629737943 Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:24:31.347929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:24:31.349413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69d2acb456bc4aaeae1ff0927195aba2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_69d2acb456bc4aaeae1ff0927195aba2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69d2acb456bc4aaeae1ff0927195aba2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/69d2acb456bc4aaeae1ff0927195aba2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:24:31.349413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-DeleteServersTestJSON-629737943 Oct 06 12:24:31.349413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 69d2acb456bc4aaeae1ff0927195aba2 Oct 06 12:24:31.349413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-DeleteServersTestJSON-629737943 Oct 06 12:24:31.349413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-DeleteServersTestJSON-629737943-project Oct 06 12:24:31.349413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:24:31.349413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:24:31.349413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 18d196263d2c49f88b5f81acb2586bc1 Oct 06 12:24:31.349413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-DeleteServersTestJSON-629737943-project Oct 06 12:24:31.349413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:24:31.349413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:31.349413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'server_id': '518de8e1-7379-4cc4-98da-0f042318420b'} Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:24:31.350274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:31.352558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:31.354194 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f62687d4-6e7d-42fe-9f43-6b88138c994f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Returning 404 to user: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:24:31.355247 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f62687d4-6e7d-42fe-9f43-6b88138c994f tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045064 Oct 06 12:24:31.356090 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 139/286] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:24:31 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:24:32.292372 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-dbfeb997-6c6f-4532-9203-2d4e2c231b30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:32.294031 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-dbfeb997-6c6f-4532-9203-2d4e2c231b30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:32.300828 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dbfeb997-6c6f-4532-9203-2d4e2c231b30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:32.301311 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dbfeb997-6c6f-4532-9203-2d4e2c231b30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:32.301785 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dbfeb997-6c6f-4532-9203-2d4e2c231b30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:32.302456 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dbfeb997-6c6f-4532-9203-2d4e2c231b30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:32.303278 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dbfeb997-6c6f-4532-9203-2d4e2c231b30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:32.303882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dbfeb997-6c6f-4532-9203-2d4e2c231b30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:32.468322 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-dbfeb997-6c6f-4532-9203-2d4e2c231b30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:32.479383 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-dbfeb997-6c6f-4532-9203-2d4e2c231b30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.191240 Oct 06 12:24:32.481747 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 148/287] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:32 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:32.661939 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d5723f71-eb8a-400c-8e99-6efb02a48a90 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:32.662398 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d5723f71-eb8a-400c-8e99-6efb02a48a90 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:32.671626 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d5723f71-eb8a-400c-8e99-6efb02a48a90 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:32.673052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d5723f71-eb8a-400c-8e99-6efb02a48a90 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:32.673495 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d5723f71-eb8a-400c-8e99-6efb02a48a90 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:32.674207 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d5723f71-eb8a-400c-8e99-6efb02a48a90 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:32.674654 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d5723f71-eb8a-400c-8e99-6efb02a48a90 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:32.675072 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d5723f71-eb8a-400c-8e99-6efb02a48a90 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:32.703074 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-d5723f71-eb8a-400c-8e99-6efb02a48a90 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] HTTP exception thrown: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d5723f71-eb8a-400c-8e99-6efb02a48a90 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Request method failure captured: Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: DELETE /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b HTTP/1.1 Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsiCRv6EsDg5STS9N350yKEL1PB84XTCp5VMU8IDJ-jB6IdO8M2Y4gIEyjePN_-i7TiRdk196RlCNFjTGI_wK3u5OAxFG8LWQhyJFI44_Gn98WAWzEeEdZGi2srudn8qfUFSt7VSL02NjOulLAZxv5oEabTW1EAYUpodfB2-cY5fDXw Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 69d2acb456bc4aaeae1ff0927195aba2 Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-DeleteServersTestJSON-629737943 Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:24:32.704899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:24:32.706263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69d2acb456bc4aaeae1ff0927195aba2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_69d2acb456bc4aaeae1ff0927195aba2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69d2acb456bc4aaeae1ff0927195aba2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/69d2acb456bc4aaeae1ff0927195aba2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:24:32.706263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-DeleteServersTestJSON-629737943 Oct 06 12:24:32.706263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 69d2acb456bc4aaeae1ff0927195aba2 Oct 06 12:24:32.706263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-DeleteServersTestJSON-629737943 Oct 06 12:24:32.706263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-DeleteServersTestJSON-629737943-project Oct 06 12:24:32.706263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:24:32.706263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:24:32.706263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 18d196263d2c49f88b5f81acb2586bc1 Oct 06 12:24:32.706263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-DeleteServersTestJSON-629737943-project Oct 06 12:24:32.706263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:24:32.706263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:32.706263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '518de8e1-7379-4cc4-98da-0f042318420b'} Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:24:32.706945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:32.708023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:32.711555 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d5723f71-eb8a-400c-8e99-6efb02a48a90 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Returning 404 to user: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:24:32.712628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d5723f71-eb8a-400c-8e99-6efb02a48a90 tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "DELETE /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 404 len: 111 microversion: 2.1 time: 0.055474 Oct 06 12:24:32.713582 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 140/288] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:24:32 2022] DELETE /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:24:32.721863 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-24308166-e454-4df0-ad40-1a0e44aa3cef tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:32.722822 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-24308166-e454-4df0-ad40-1a0e44aa3cef tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] [instance: 518de8e1-7379-4cc4-98da-0f042318420b] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:32.729135 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-24308166-e454-4df0-ad40-1a0e44aa3cef tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:32.729895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-24308166-e454-4df0-ad40-1a0e44aa3cef tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:32.730675 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-24308166-e454-4df0-ad40-1a0e44aa3cef tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:32.731793 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-24308166-e454-4df0-ad40-1a0e44aa3cef tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:32.732248 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-24308166-e454-4df0-ad40-1a0e44aa3cef tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:32.732830 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-24308166-e454-4df0-ad40-1a0e44aa3cef tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:32.748101 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-24308166-e454-4df0-ad40-1a0e44aa3cef tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] HTTP exception thrown: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-24308166-e454-4df0-ad40-1a0e44aa3cef tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Request method failure captured: Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b HTTP/1.1 Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPsiCRv6EsDg5STS9N350yKEL1PB84XTCp5VMU8IDJ-jB6IdO8M2Y4gIEyjePN_-i7TiRdk196RlCNFjTGI_wK3u5OAxFG8LWQhyJFI44_Gn98WAWzEeEdZGi2srudn8qfUFSt7VSL02NjOulLAZxv5oEabTW1EAYUpodfB2-cY5fDXw Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: 69d2acb456bc4aaeae1ff0927195aba2 Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-DeleteServersTestJSON-629737943 Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:24:32.753637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:24:32.755021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69d2acb456bc4aaeae1ff0927195aba2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_69d2acb456bc4aaeae1ff0927195aba2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69d2acb456bc4aaeae1ff0927195aba2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/69d2acb456bc4aaeae1ff0927195aba2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:24:32.755021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-DeleteServersTestJSON-629737943 Oct 06 12:24:32.755021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: 69d2acb456bc4aaeae1ff0927195aba2 Oct 06 12:24:32.755021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-DeleteServersTestJSON-629737943 Oct 06 12:24:32.755021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-DeleteServersTestJSON-629737943-project Oct 06 12:24:32.755021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:24:32.755021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:24:32.755021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 18d196263d2c49f88b5f81acb2586bc1 Oct 06 12:24:32.755021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-DeleteServersTestJSON-629737943-project Oct 06 12:24:32.755021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:24:32.755021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:32.755021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '518de8e1-7379-4cc4-98da-0f042318420b'} Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:24:32.755718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. Oct 06 12:24:32.756768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:24:32.759423 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-24308166-e454-4df0-ad40-1a0e44aa3cef tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] Returning 404 to user: Instance 518de8e1-7379-4cc4-98da-0f042318420b could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:24:32.761202 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-24308166-e454-4df0-ad40-1a0e44aa3cef tempest-DeleteServersTestJSON-629737943 tempest-DeleteServersTestJSON-629737943-project] 10.222.0.33 "GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b" status: 404 len: 111 microversion: 2.1 time: 0.043746 Oct 06 12:24:32.762676 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 149/289] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:32 2022] GET /compute/v2.1/servers/518de8e1-7379-4cc4-98da-0f042318420b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:24:33.504357 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-32e1d024-b3ec-4000-8e5b-a88d5a23a103 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:33.504357 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-32e1d024-b3ec-4000-8e5b-a88d5a23a103 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:33.510989 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-32e1d024-b3ec-4000-8e5b-a88d5a23a103 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:33.513208 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-32e1d024-b3ec-4000-8e5b-a88d5a23a103 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:33.513848 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-32e1d024-b3ec-4000-8e5b-a88d5a23a103 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:33.515639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-32e1d024-b3ec-4000-8e5b-a88d5a23a103 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:33.516507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-32e1d024-b3ec-4000-8e5b-a88d5a23a103 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:33.517142 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-32e1d024-b3ec-4000-8e5b-a88d5a23a103 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:33.834596 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-32e1d024-b3ec-4000-8e5b-a88d5a23a103 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:33.853763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-32e1d024-b3ec-4000-8e5b-a88d5a23a103 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.353630 Oct 06 12:24:33.868628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 141/290] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:33 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:34.878909 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c4c6ae1d-dd55-4e30-8d38-360c6e7d8b89 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:34.879678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c4c6ae1d-dd55-4e30-8d38-360c6e7d8b89 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:34.892163 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c4c6ae1d-dd55-4e30-8d38-360c6e7d8b89 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:34.892995 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c4c6ae1d-dd55-4e30-8d38-360c6e7d8b89 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:34.893491 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c4c6ae1d-dd55-4e30-8d38-360c6e7d8b89 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:34.894552 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c4c6ae1d-dd55-4e30-8d38-360c6e7d8b89 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:34.895229 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c4c6ae1d-dd55-4e30-8d38-360c6e7d8b89 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:34.895859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c4c6ae1d-dd55-4e30-8d38-360c6e7d8b89 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:35.154191 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c4c6ae1d-dd55-4e30-8d38-360c6e7d8b89 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:35.170637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c4c6ae1d-dd55-4e30-8d38-360c6e7d8b89 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.289520 Oct 06 12:24:35.171292 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 150/291] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:34 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:36.195180 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4ecdacfd-61de-4f88-83d7-4fec6db2f652 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:36.197388 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4ecdacfd-61de-4f88-83d7-4fec6db2f652 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:36.205996 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ecdacfd-61de-4f88-83d7-4fec6db2f652 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:36.207437 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ecdacfd-61de-4f88-83d7-4fec6db2f652 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:36.208140 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ecdacfd-61de-4f88-83d7-4fec6db2f652 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:36.209329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ecdacfd-61de-4f88-83d7-4fec6db2f652 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:36.210057 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ecdacfd-61de-4f88-83d7-4fec6db2f652 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:36.210713 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ecdacfd-61de-4f88-83d7-4fec6db2f652 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:36.408520 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4ecdacfd-61de-4f88-83d7-4fec6db2f652 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:36.422025 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4ecdacfd-61de-4f88-83d7-4fec6db2f652 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.231434 Oct 06 12:24:36.423166 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 142/292] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:36 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:37.447990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3684f882-7aad-4268-bcc7-98d96052e488 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:37.448709 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3684f882-7aad-4268-bcc7-98d96052e488 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:37.456088 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3684f882-7aad-4268-bcc7-98d96052e488 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:37.456573 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3684f882-7aad-4268-bcc7-98d96052e488 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:37.457001 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3684f882-7aad-4268-bcc7-98d96052e488 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:37.457751 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3684f882-7aad-4268-bcc7-98d96052e488 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:37.458227 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3684f882-7aad-4268-bcc7-98d96052e488 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:37.459722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3684f882-7aad-4268-bcc7-98d96052e488 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:37.594981 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1010663480", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "networks": [{"uuid": "a3b35b13-487e-4ccb-b137-7c1ff7b66ae5"}]}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:24:37.724417 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3684f882-7aad-4268-bcc7-98d96052e488 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:37.733704 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3684f882-7aad-4268-bcc7-98d96052e488 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.289878 Oct 06 12:24:37.734056 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.network.neutron [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] validate_networks() for [('a3b35b13-487e-4ccb-b137-7c1ff7b66ae5', None, None, None, None, None)] {{(pid=120509) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:24:37.734451 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 151/293] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:37 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:38.174030 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Flavor limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:24:38.174448 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Image limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:24:38.174924 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Flavor pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:24:38.175324 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Image pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:24:38.175758 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:24:38.185858 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:38.186450 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:38.186883 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:38.187633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:38.188086 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:38.188507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:38.208092 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Getting quotas for project 53e1ba5fc96344cebdb16d6a3e50ab8f. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:24:38.213425 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Getting quotas for user 8d817e129beb41168af70c3ada99aeda and project 53e1ba5fc96344cebdb16d6a3e50ab8f. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:24:38.227223 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Going to run 1 instances... {{(pid=120509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:24:38.229783 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:24:38.285516 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-429093a3-ef70-4baf-ba29-898f241590c6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691486 Oct 06 12:24:38.285516 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 143/294] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:24:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:24:38.296157 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-bf4ea801-c174-44c2-b4ac-00a428f3975e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:38.299842 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-bf4ea801-c174-44c2-b4ac-00a428f3975e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:38.383797 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-bf4ea801-c174-44c2-b4ac-00a428f3975e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:38.391548 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-bf4ea801-c174-44c2-b4ac-00a428f3975e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1214 microversion: 2.1 time: 0.101223 Oct 06 12:24:38.393338 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 152/295] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:38 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:38.759770 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-cec38c35-0298-4653-b1eb-459f5303ef19 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:38.760334 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-cec38c35-0298-4653-b1eb-459f5303ef19 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:38.769676 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cec38c35-0298-4653-b1eb-459f5303ef19 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:38.770036 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cec38c35-0298-4653-b1eb-459f5303ef19 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:38.770474 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cec38c35-0298-4653-b1eb-459f5303ef19 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:38.771185 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cec38c35-0298-4653-b1eb-459f5303ef19 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:38.771657 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cec38c35-0298-4653-b1eb-459f5303ef19 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:38.772083 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cec38c35-0298-4653-b1eb-459f5303ef19 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:38.996474 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-cec38c35-0298-4653-b1eb-459f5303ef19 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:39.009116 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-cec38c35-0298-4653-b1eb-459f5303ef19 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.254083 Oct 06 12:24:39.025003 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 144/296] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:38 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:39.415936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-536442bf-fd68-4b1b-b9cb-95a31323c3be tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:39.417423 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-536442bf-fd68-4b1b-b9cb-95a31323c3be tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:39.424380 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-536442bf-fd68-4b1b-b9cb-95a31323c3be tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:39.425164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-536442bf-fd68-4b1b-b9cb-95a31323c3be tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:39.425919 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-536442bf-fd68-4b1b-b9cb-95a31323c3be tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:39.426827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-536442bf-fd68-4b1b-b9cb-95a31323c3be tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:39.427483 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-536442bf-fd68-4b1b-b9cb-95a31323c3be tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:39.428132 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-536442bf-fd68-4b1b-b9cb-95a31323c3be tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:39.513138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-536442bf-fd68-4b1b-b9cb-95a31323c3be tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:39.524503 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-536442bf-fd68-4b1b-b9cb-95a31323c3be tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1266 microversion: 2.1 time: 0.110715 Oct 06 12:24:39.525570 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 153/297] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:39 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:40.045018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-179cdf1a-3a71-4e01-b926-17ca16cad5a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:40.047938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-179cdf1a-3a71-4e01-b926-17ca16cad5a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:40.065378 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-179cdf1a-3a71-4e01-b926-17ca16cad5a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:40.073219 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-179cdf1a-3a71-4e01-b926-17ca16cad5a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:40.073894 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-179cdf1a-3a71-4e01-b926-17ca16cad5a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:40.074796 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-179cdf1a-3a71-4e01-b926-17ca16cad5a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:40.075709 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-179cdf1a-3a71-4e01-b926-17ca16cad5a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:40.076291 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-179cdf1a-3a71-4e01-b926-17ca16cad5a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:40.425926 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-179cdf1a-3a71-4e01-b926-17ca16cad5a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:40.438602 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-179cdf1a-3a71-4e01-b926-17ca16cad5a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.408015 Oct 06 12:24:40.453050 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 145/298] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:40 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:40.550992 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c626d6f0-14c2-43dd-99d4-cdc4362892e1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:40.552488 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c626d6f0-14c2-43dd-99d4-cdc4362892e1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:40.562034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c626d6f0-14c2-43dd-99d4-cdc4362892e1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:40.562950 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c626d6f0-14c2-43dd-99d4-cdc4362892e1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:40.563634 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c626d6f0-14c2-43dd-99d4-cdc4362892e1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:40.564606 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c626d6f0-14c2-43dd-99d4-cdc4362892e1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:40.565262 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c626d6f0-14c2-43dd-99d4-cdc4362892e1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:40.566145 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c626d6f0-14c2-43dd-99d4-cdc4362892e1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:40.646612 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c626d6f0-14c2-43dd-99d4-cdc4362892e1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:40.664049 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c626d6f0-14c2-43dd-99d4-cdc4362892e1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1272 microversion: 2.1 time: 0.116534 Oct 06 12:24:40.665144 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 154/299] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:40 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:41.464778 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e0b22362-e88c-41f0-adc8-db554102a09d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:41.465283 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e0b22362-e88c-41f0-adc8-db554102a09d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:41.471181 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e0b22362-e88c-41f0-adc8-db554102a09d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:41.471711 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e0b22362-e88c-41f0-adc8-db554102a09d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:41.472150 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e0b22362-e88c-41f0-adc8-db554102a09d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:41.472831 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e0b22362-e88c-41f0-adc8-db554102a09d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:41.473274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e0b22362-e88c-41f0-adc8-db554102a09d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:41.473695 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e0b22362-e88c-41f0-adc8-db554102a09d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:41.689703 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7b43b487-f230-42c0-9bcf-4a58f8e784f2 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:41.690405 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7b43b487-f230-42c0-9bcf-4a58f8e784f2 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:41.697605 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7b43b487-f230-42c0-9bcf-4a58f8e784f2 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:41.698498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7b43b487-f230-42c0-9bcf-4a58f8e784f2 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:41.699291 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7b43b487-f230-42c0-9bcf-4a58f8e784f2 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:41.700305 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7b43b487-f230-42c0-9bcf-4a58f8e784f2 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:41.700842 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7b43b487-f230-42c0-9bcf-4a58f8e784f2 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:41.701538 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7b43b487-f230-42c0-9bcf-4a58f8e784f2 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:41.716386 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e0b22362-e88c-41f0-adc8-db554102a09d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:41.725771 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e0b22362-e88c-41f0-adc8-db554102a09d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.264805 Oct 06 12:24:41.742944 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 146/300] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:41 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:41.917919 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7b43b487-f230-42c0-9bcf-4a58f8e784f2 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:41.926368 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7b43b487-f230-42c0-9bcf-4a58f8e784f2 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1272 microversion: 2.1 time: 0.241848 Oct 06 12:24:41.927291 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 155/301] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:41 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:24:42.750193 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-18058e0e-d956-4a1d-b645-37890bb324c5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:42.750790 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-18058e0e-d956-4a1d-b645-37890bb324c5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:42.758125 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-18058e0e-d956-4a1d-b645-37890bb324c5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:42.759497 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-18058e0e-d956-4a1d-b645-37890bb324c5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:42.760130 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-18058e0e-d956-4a1d-b645-37890bb324c5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:42.761295 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-18058e0e-d956-4a1d-b645-37890bb324c5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:42.761750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-18058e0e-d956-4a1d-b645-37890bb324c5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:42.762337 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-18058e0e-d956-4a1d-b645-37890bb324c5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:42.935256 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-18058e0e-d956-4a1d-b645-37890bb324c5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:42.938860 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:42.946682 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-18058e0e-d956-4a1d-b645-37890bb324c5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.200501 Oct 06 12:24:42.947444 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 147/302] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:42 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:42.955690 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a5a62441-f5e5-4334-954e-9cfd1252a4b0 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:42.955690 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a5a62441-f5e5-4334-954e-9cfd1252a4b0 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:42.967464 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5a62441-f5e5-4334-954e-9cfd1252a4b0 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:42.968428 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5a62441-f5e5-4334-954e-9cfd1252a4b0 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:42.969715 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5a62441-f5e5-4334-954e-9cfd1252a4b0 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:42.970570 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5a62441-f5e5-4334-954e-9cfd1252a4b0 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:42.971148 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5a62441-f5e5-4334-954e-9cfd1252a4b0 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:42.971800 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5a62441-f5e5-4334-954e-9cfd1252a4b0 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:43.060469 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a5a62441-f5e5-4334-954e-9cfd1252a4b0 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:43.070313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a5a62441-f5e5-4334-954e-9cfd1252a4b0 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1272 microversion: 2.1 time: 0.124080 Oct 06 12:24:43.071935 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 156/303] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:42 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:24:43.971221 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-dba7ae82-b90e-439a-b8e0-a207388bc27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:43.971760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-dba7ae82-b90e-439a-b8e0-a207388bc27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:43.985272 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-dba7ae82-b90e-439a-b8e0-a207388bc27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:43.987611 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-dba7ae82-b90e-439a-b8e0-a207388bc27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:43.988129 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-dba7ae82-b90e-439a-b8e0-a207388bc27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:43.989235 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-dba7ae82-b90e-439a-b8e0-a207388bc27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:43.991837 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-dba7ae82-b90e-439a-b8e0-a207388bc27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:43.992306 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-dba7ae82-b90e-439a-b8e0-a207388bc27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:44.094163 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8ea241e1-95c0-4334-92f6-644ff35c259b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:44.094789 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8ea241e1-95c0-4334-92f6-644ff35c259b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:44.107987 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8ea241e1-95c0-4334-92f6-644ff35c259b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:44.111912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8ea241e1-95c0-4334-92f6-644ff35c259b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:44.112527 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8ea241e1-95c0-4334-92f6-644ff35c259b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:44.116305 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8ea241e1-95c0-4334-92f6-644ff35c259b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:44.117218 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8ea241e1-95c0-4334-92f6-644ff35c259b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:44.118613 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8ea241e1-95c0-4334-92f6-644ff35c259b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:44.201536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-dba7ae82-b90e-439a-b8e0-a207388bc27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:44.203711 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8ea241e1-95c0-4334-92f6-644ff35c259b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:44.210830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-dba7ae82-b90e-439a-b8e0-a207388bc27d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.244948 Oct 06 12:24:44.211687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 148/304] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:43 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:44.224964 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8ea241e1-95c0-4334-92f6-644ff35c259b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1272 microversion: 2.1 time: 0.132733 Oct 06 12:24:44.229258 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 157/305] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:44 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:44.374416 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-50670027-7446-4236-ab25-2a636308e90b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Action: 'create', calling method: .version_select at 0x7f03aadcc430>, body: {"keypair": {"name": "tempest-keypair-133641512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNxiY7vnk93fjix1lFl93RsaPEvp7RZoRv10/Ob8wX9snufzkLDGMaW9REi1NC0y9PVcaIxm089LPmvEloWLDDyzF7VIEE9LIv7amHi6pi6rVNXzrIDbCrKRa/leGDSWg=="}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:24:44.400266 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-50670027-7446-4236-ab25-2a636308e90b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Getting quotas for project eda6037b1d4b4d31b7a7ad298452cfbb. Resources: {'key_pairs'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:24:44.404515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-50670027-7446-4236-ab25-2a636308e90b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Getting quotas for user ff9c115c7083441c8b363e9b685ef110 and project eda6037b1d4b4d31b7a7ad298452cfbb. Resources: {'key_pairs'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:24:44.473826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-50670027-7446-4236-ab25-2a636308e90b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.260633 Oct 06 12:24:44.474646 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 149/306] 10.222.0.33 () {62 vars in 1200 bytes} [Thu Oct 6 12:24:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 262 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 06 12:24:45.244630 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-516fb061-4e39-4c22-ac07-3f949e23ac90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:45.245150 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-516fb061-4e39-4c22-ac07-3f949e23ac90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:45.252578 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-516fb061-4e39-4c22-ac07-3f949e23ac90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:45.252749 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e178994b-0e34-4b1a-b50b-e63f2f9d87cc tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:45.253468 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e178994b-0e34-4b1a-b50b-e63f2f9d87cc tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:45.254395 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-516fb061-4e39-4c22-ac07-3f949e23ac90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:45.255195 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-516fb061-4e39-4c22-ac07-3f949e23ac90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:45.256186 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-516fb061-4e39-4c22-ac07-3f949e23ac90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:45.257343 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-516fb061-4e39-4c22-ac07-3f949e23ac90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:45.257814 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-516fb061-4e39-4c22-ac07-3f949e23ac90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:45.260546 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e178994b-0e34-4b1a-b50b-e63f2f9d87cc tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:45.261220 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e178994b-0e34-4b1a-b50b-e63f2f9d87cc tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:45.261800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e178994b-0e34-4b1a-b50b-e63f2f9d87cc tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:45.262694 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e178994b-0e34-4b1a-b50b-e63f2f9d87cc tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:45.263141 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e178994b-0e34-4b1a-b50b-e63f2f9d87cc tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:45.263581 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e178994b-0e34-4b1a-b50b-e63f2f9d87cc tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:45.278577 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=100 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:45.729708 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-516fb061-4e39-4c22-ac07-3f949e23ac90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:45.737385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-516fb061-4e39-4c22-ac07-3f949e23ac90 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.496871 Oct 06 12:24:45.738030 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 158/307] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:45 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:45.745356 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e178994b-0e34-4b1a-b50b-e63f2f9d87cc tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:45.753509 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e178994b-0e34-4b1a-b50b-e63f2f9d87cc tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.505045 Oct 06 12:24:45.754088 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 150/308] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:45 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:46.323230 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-696803178", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a983a2d0-c8c4-4203-b602-635e6e2680bd"}], "security_groups": [{"name": "tempest-securitygroup--331245557"}], "key_name": "tempest-keypair-133641512", "user_data": "}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:24:46.477596 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.network.neutron [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] validate_networks() for [('a983a2d0-c8c4-4203-b602-635e6e2680bd', None, None, None, None, None)] {{(pid=120508) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:24:46.765648 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4fa245bb-22cb-4225-8fdf-6ae2c448e4f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:46.766625 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4fa245bb-22cb-4225-8fdf-6ae2c448e4f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:46.776732 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4fa245bb-22cb-4225-8fdf-6ae2c448e4f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:46.779190 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4fa245bb-22cb-4225-8fdf-6ae2c448e4f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:46.779799 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4fa245bb-22cb-4225-8fdf-6ae2c448e4f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:46.782550 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4fa245bb-22cb-4225-8fdf-6ae2c448e4f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:46.783238 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4fa245bb-22cb-4225-8fdf-6ae2c448e4f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:46.785465 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4fa245bb-22cb-4225-8fdf-6ae2c448e4f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:47.098759 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4fa245bb-22cb-4225-8fdf-6ae2c448e4f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:47.113987 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4fa245bb-22cb-4225-8fdf-6ae2c448e4f9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.352988 Oct 06 12:24:47.115149 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 151/309] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:46 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:47.128882 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-20079fe1-4379-4f3a-901c-013de7d8f59d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:47.132036 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-20079fe1-4379-4f3a-901c-013de7d8f59d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:47.144472 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-20079fe1-4379-4f3a-901c-013de7d8f59d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:47.151095 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-20079fe1-4379-4f3a-901c-013de7d8f59d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:47.151594 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-20079fe1-4379-4f3a-901c-013de7d8f59d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:47.152405 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-20079fe1-4379-4f3a-901c-013de7d8f59d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:47.153086 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-20079fe1-4379-4f3a-901c-013de7d8f59d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:47.154189 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-20079fe1-4379-4f3a-901c-013de7d8f59d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:47.369324 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Flavor limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:24:47.371599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Image limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:24:47.372314 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Flavor pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:24:47.373057 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Image pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:24:47.373631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:24:47.387427 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:47.388253 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:47.390245 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:47.391278 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:47.391937 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:47.392454 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:47.404764 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-20079fe1-4379-4f3a-901c-013de7d8f59d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:47.417492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-20079fe1-4379-4f3a-901c-013de7d8f59d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.298409 Oct 06 12:24:47.419144 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Getting quotas for project eda6037b1d4b4d31b7a7ad298452cfbb. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:24:47.424023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 152/310] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:47 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:47.424159 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Getting quotas for user ff9c115c7083441c8b363e9b685ef110 and project eda6037b1d4b4d31b7a7ad298452cfbb. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:24:47.437474 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Going to run 1 instances... {{(pid=120508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:24:47.438251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-e3a829c9-9413-48a0-ada5-4513819d195e req-967d4967-0cfc-447d-b528-5b9810e7bdb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf13a44-e331-4b28-9d44-6890e99df4de", "tag": "ecb33657-c68d-4387-95f1-ade395dddf6a"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:24:47.439847 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:24:47.448554 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-e3a829c9-9413-48a0-ada5-4513819d195e req-967d4967-0cfc-447d-b528-5b9810e7bdb3 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:47.449036 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-e3a829c9-9413-48a0-ada5-4513819d195e req-967d4967-0cfc-447d-b528-5b9810e7bdb3 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:47.449464 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-e3a829c9-9413-48a0-ada5-4513819d195e req-967d4967-0cfc-447d-b528-5b9810e7bdb3 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:47.461445 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-e3a829c9-9413-48a0-ada5-4513819d195e req-967d4967-0cfc-447d-b528-5b9810e7bdb3 service nova] Creating event network-changed:ecb33657-c68d-4387-95f1-ade395dddf6a for instance 5bf13a44-e331-4b28-9d44-6890e99df4de on hv-cinder-85604 Oct 06 12:24:47.466521 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-e3a829c9-9413-48a0-ada5-4513819d195e req-967d4967-0cfc-447d-b528-5b9810e7bdb3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039061 Oct 06 12:24:47.467119 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 153/311] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:24:47.491293 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d8d7056b-fe6f-4559-885e-7ad13d05b986 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.181881 Oct 06 12:24:47.491975 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 159/312] 10.222.0.33 () {62 vars in 1188 bytes} [Thu Oct 6 12:24:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 12:24:47.512813 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0c7f2902-8bc9-4bd8-b96d-a6bc371c269d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:47.513605 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0c7f2902-8bc9-4bd8-b96d-a6bc371c269d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:47.575975 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0c7f2902-8bc9-4bd8-b96d-a6bc371c269d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:47.585046 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0c7f2902-8bc9-4bd8-b96d-a6bc371c269d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:47.586498 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0c7f2902-8bc9-4bd8-b96d-a6bc371c269d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:47.588777 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0c7f2902-8bc9-4bd8-b96d-a6bc371c269d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1280 microversion: 2.20 time: 0.080666 Oct 06 12:24:47.589651 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 154/313] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:24:47 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1280 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:24:48.142266 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1e8c8754-8fdc-4fbe-ab90-a93479231265 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:48.142902 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-1e8c8754-8fdc-4fbe-ab90-a93479231265 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:48.149829 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1e8c8754-8fdc-4fbe-ab90-a93479231265 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:48.150323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1e8c8754-8fdc-4fbe-ab90-a93479231265 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:48.150761 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1e8c8754-8fdc-4fbe-ab90-a93479231265 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:48.151499 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1e8c8754-8fdc-4fbe-ab90-a93479231265 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:48.151985 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1e8c8754-8fdc-4fbe-ab90-a93479231265 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:48.152414 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1e8c8754-8fdc-4fbe-ab90-a93479231265 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:48.296239 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-1e8c8754-8fdc-4fbe-ab90-a93479231265 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:48.305399 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-1e8c8754-8fdc-4fbe-ab90-a93479231265 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.167475 Oct 06 12:24:48.306129 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 160/314] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:48 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:48.441284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3e401344-4822-49dc-8f49-5661da5b95b8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:48.441955 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3e401344-4822-49dc-8f49-5661da5b95b8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:48.444779 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:48.455035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3e401344-4822-49dc-8f49-5661da5b95b8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:48.456282 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3e401344-4822-49dc-8f49-5661da5b95b8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:48.456931 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3e401344-4822-49dc-8f49-5661da5b95b8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:48.458331 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3e401344-4822-49dc-8f49-5661da5b95b8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:48.459296 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3e401344-4822-49dc-8f49-5661da5b95b8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:48.460368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3e401344-4822-49dc-8f49-5661da5b95b8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:48.613726 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d6a94b03-9369-432d-8d53-86a2768374f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:48.614408 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d6a94b03-9369-432d-8d53-86a2768374f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:48.621306 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6a94b03-9369-432d-8d53-86a2768374f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:48.622056 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6a94b03-9369-432d-8d53-86a2768374f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:48.622645 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6a94b03-9369-432d-8d53-86a2768374f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:48.623557 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6a94b03-9369-432d-8d53-86a2768374f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:48.624191 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6a94b03-9369-432d-8d53-86a2768374f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:48.624617 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6a94b03-9369-432d-8d53-86a2768374f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:48.658281 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3e401344-4822-49dc-8f49-5661da5b95b8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:48.669592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3e401344-4822-49dc-8f49-5661da5b95b8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.232257 Oct 06 12:24:48.687894 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 155/315] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:48 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:48.746251 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d6a94b03-9369-432d-8d53-86a2768374f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:48.758915 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d6a94b03-9369-432d-8d53-86a2768374f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:48.761125 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d6a94b03-9369-432d-8d53-86a2768374f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:48.762263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d6a94b03-9369-432d-8d53-86a2768374f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1332 microversion: 2.20 time: 0.152621 Oct 06 12:24:48.762824 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 161/316] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:24:48 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1332 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:24:49.330461 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2322c5be-b6a5-4d79-bf7d-409c5f9af6e5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:49.331059 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2322c5be-b6a5-4d79-bf7d-409c5f9af6e5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:49.336989 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2322c5be-b6a5-4d79-bf7d-409c5f9af6e5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:49.337467 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2322c5be-b6a5-4d79-bf7d-409c5f9af6e5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:49.337897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2322c5be-b6a5-4d79-bf7d-409c5f9af6e5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:49.338578 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2322c5be-b6a5-4d79-bf7d-409c5f9af6e5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:49.339025 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2322c5be-b6a5-4d79-bf7d-409c5f9af6e5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:49.339446 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2322c5be-b6a5-4d79-bf7d-409c5f9af6e5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:49.478797 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2322c5be-b6a5-4d79-bf7d-409c5f9af6e5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:49.501344 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2322c5be-b6a5-4d79-bf7d-409c5f9af6e5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.172562 Oct 06 12:24:49.501970 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 156/317] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:49 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:49.694782 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4ad93e94-8118-4d9e-9ee4-a598a82ba22d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:49.695393 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-4ad93e94-8118-4d9e-9ee4-a598a82ba22d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:49.701945 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4ad93e94-8118-4d9e-9ee4-a598a82ba22d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:49.702421 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4ad93e94-8118-4d9e-9ee4-a598a82ba22d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:49.702848 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4ad93e94-8118-4d9e-9ee4-a598a82ba22d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:49.703591 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4ad93e94-8118-4d9e-9ee4-a598a82ba22d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:49.704042 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4ad93e94-8118-4d9e-9ee4-a598a82ba22d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:49.704459 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4ad93e94-8118-4d9e-9ee4-a598a82ba22d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:49.790774 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-563d7fcb-5a08-4b9a-83bd-88c2a1371168 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:49.790774 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-563d7fcb-5a08-4b9a-83bd-88c2a1371168 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:49.791617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:49.797728 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-563d7fcb-5a08-4b9a-83bd-88c2a1371168 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:49.798283 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-563d7fcb-5a08-4b9a-83bd-88c2a1371168 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:49.798714 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-563d7fcb-5a08-4b9a-83bd-88c2a1371168 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:49.799404 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-563d7fcb-5a08-4b9a-83bd-88c2a1371168 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:49.799881 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-563d7fcb-5a08-4b9a-83bd-88c2a1371168 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:49.800293 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-563d7fcb-5a08-4b9a-83bd-88c2a1371168 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:49.848250 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4ad93e94-8118-4d9e-9ee4-a598a82ba22d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:49.857448 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4ad93e94-8118-4d9e-9ee4-a598a82ba22d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.166633 Oct 06 12:24:49.858220 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 162/318] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:49 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:49.865174 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-563d7fcb-5a08-4b9a-83bd-88c2a1371168 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:49.873261 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-563d7fcb-5a08-4b9a-83bd-88c2a1371168 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:49.874683 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-563d7fcb-5a08-4b9a-83bd-88c2a1371168 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:49.875780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-563d7fcb-5a08-4b9a-83bd-88c2a1371168 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1332 microversion: 2.20 time: 0.091218 Oct 06 12:24:49.876316 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 157/319] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:24:49 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1332 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:24:50.528475 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-133ae3b5-fc73-4a27-a6b5-143daf68d40a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:50.529095 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-133ae3b5-fc73-4a27-a6b5-143daf68d40a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:50.535603 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-133ae3b5-fc73-4a27-a6b5-143daf68d40a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:50.536270 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-133ae3b5-fc73-4a27-a6b5-143daf68d40a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:50.537158 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-133ae3b5-fc73-4a27-a6b5-143daf68d40a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:50.538689 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-133ae3b5-fc73-4a27-a6b5-143daf68d40a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:50.539307 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-133ae3b5-fc73-4a27-a6b5-143daf68d40a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:50.540060 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-133ae3b5-fc73-4a27-a6b5-143daf68d40a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:50.686715 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-133ae3b5-fc73-4a27-a6b5-143daf68d40a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:50.695117 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-133ae3b5-fc73-4a27-a6b5-143daf68d40a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1501 microversion: 2.1 time: 0.174672 Oct 06 12:24:50.703891 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 163/320] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:50 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1501 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:50.718412 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8081a6c6-44e4-4bfd-8da2-23ba83de67e4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca818626-8562-4ece-8531-f8c6533d4663"}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:24:50.720879 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8081a6c6-44e4-4bfd-8da2-23ba83de67e4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:50.728294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8081a6c6-44e4-4bfd-8da2-23ba83de67e4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:50.729917 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8081a6c6-44e4-4bfd-8da2-23ba83de67e4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:50.730465 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8081a6c6-44e4-4bfd-8da2-23ba83de67e4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:50.731245 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8081a6c6-44e4-4bfd-8da2-23ba83de67e4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:50.731761 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8081a6c6-44e4-4bfd-8da2-23ba83de67e4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:50.732209 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8081a6c6-44e4-4bfd-8da2-23ba83de67e4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:50.756165 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-8081a6c6-44e4-4bfd-8da2-23ba83de67e4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] HTTP exception thrown: Cannot 'attach_volume' instance 6bdd2944-b97f-40e0-a1cb-915cea031265 while it is in vm_state rescued Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8081a6c6-44e4-4bfd-8da2-23ba83de67e4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Request method failure captured: Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: POST /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265/os-volume_attachments HTTP/1.1 Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 74 Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsh-PJ9xvBXdfQe_7UormM1Qyx0qepQqe1wI78PUDz3eEOb52qjqvlvg_d8nEkHrVtXCoBdXqhuEix6aY08jzJfIy6nrnz7MkzwZ2sOKibXZ2ZU4L1xUu_NrfA_ABN8p0EemOJk_E32lA71Qz_KuMtDmQk38cZgrdfRfT30A7Fp6Ci4 Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 9138bc89f5204975a18156097530643a Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-754252330 Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:24:50.757785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:24:50.759287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9138bc89f5204975a18156097530643a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9138bc89f5204975a18156097530643a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9138bc89f5204975a18156097530643a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9138bc89f5204975a18156097530643a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:24:50.759287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-ServerRescueNegativeTestJSON-754252330 Oct 06 12:24:50.759287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 9138bc89f5204975a18156097530643a Oct 06 12:24:50.759287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-754252330 Oct 06 12:24:50.759287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-ServerRescueNegativeTestJSON-754252330-project Oct 06 12:24:50.759287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:24:50.759287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:24:50.759287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 1f4cbe342b2c4378b3c0ab2f1cd55260 Oct 06 12:24:50.759287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-ServerRescueNegativeTestJSON-754252330-project Oct 06 12:24:50.759287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Oct 06 12:24:50.759287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {"volumeAttachment": {"volumeId": "ca818626-8562-4ece-8531-f8c6533d4663"}} Oct 06 12:24:50.759287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Cannot 'attach_volume' instance 6bdd2944-b97f-40e0-a1cb-915cea031265 while it is in vm_state rescued Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'server_id': '6bdd2944-b97f-40e0-a1cb-915cea031265', 'body': {'volumeAttachment': {'volumeId': 'ca818626-8562-4ece-8531-f8c6533d4663'}}} Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6bdd2944-b97f-40e0-a1cb-915cea031265 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:24:50.764013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6bdd2944-b97f-40e0-a1cb-915cea031265 while it is in vm_state rescued Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:24:50.765494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:24:50.766854 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:24:50.766854 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:24:50.766854 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6bdd2944-b97f-40e0-a1cb-915cea031265 while it is in vm_state rescued Oct 06 12:24:50.766854 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:24:50.766854 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8081a6c6-44e4-4bfd-8da2-23ba83de67e4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Returning 409 to user: Cannot 'attach_volume' instance 6bdd2944-b97f-40e0-a1cb-915cea031265 while it is in vm_state rescued {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:24:50.766854 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8081a6c6-44e4-4bfd-8da2-23ba83de67e4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "POST /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044918 Oct 06 12:24:50.766854 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 158/321] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 12:24:50 2022] POST /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:24:50.768846 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-702d1d1c-9243-44a2-8751-2311ad8757a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:24:50.769451 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-702d1d1c-9243-44a2-8751-2311ad8757a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:50.776243 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-702d1d1c-9243-44a2-8751-2311ad8757a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:50.776731 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-702d1d1c-9243-44a2-8751-2311ad8757a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:50.777166 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-702d1d1c-9243-44a2-8751-2311ad8757a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:50.777862 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-702d1d1c-9243-44a2-8751-2311ad8757a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:50.778318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-702d1d1c-9243-44a2-8751-2311ad8757a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:50.778743 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-702d1d1c-9243-44a2-8751-2311ad8757a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:50.851224 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-702d1d1c-9243-44a2-8751-2311ad8757a2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "POST /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265/action" status: 202 len: 0 microversion: 2.1 time: 0.085093 Oct 06 12:24:50.852024 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 164/322] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 12:24:50 2022] POST /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 12:24:50.860225 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9bcd6d3f-6af8-449f-8ff7-48d94cdd1f37 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:50.861005 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9bcd6d3f-6af8-449f-8ff7-48d94cdd1f37 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:50.866782 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9bcd6d3f-6af8-449f-8ff7-48d94cdd1f37 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:50.867253 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9bcd6d3f-6af8-449f-8ff7-48d94cdd1f37 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:50.867893 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9bcd6d3f-6af8-449f-8ff7-48d94cdd1f37 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:50.868576 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9bcd6d3f-6af8-449f-8ff7-48d94cdd1f37 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:50.869022 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9bcd6d3f-6af8-449f-8ff7-48d94cdd1f37 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:50.869440 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9bcd6d3f-6af8-449f-8ff7-48d94cdd1f37 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:50.881236 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a4851921-5ecb-430e-8fdf-94eb3e0c6264 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:50.882244 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a4851921-5ecb-430e-8fdf-94eb3e0c6264 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:50.891645 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a4851921-5ecb-430e-8fdf-94eb3e0c6264 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:50.892373 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a4851921-5ecb-430e-8fdf-94eb3e0c6264 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:50.893000 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a4851921-5ecb-430e-8fdf-94eb3e0c6264 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:50.893762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a4851921-5ecb-430e-8fdf-94eb3e0c6264 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:50.894225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a4851921-5ecb-430e-8fdf-94eb3e0c6264 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:50.894694 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a4851921-5ecb-430e-8fdf-94eb3e0c6264 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:51.084628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9bcd6d3f-6af8-449f-8ff7-48d94cdd1f37 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:51.094418 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9bcd6d3f-6af8-449f-8ff7-48d94cdd1f37 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1509 microversion: 2.1 time: 0.237965 Oct 06 12:24:51.095700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 159/323] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:50 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:51.098000 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a4851921-5ecb-430e-8fdf-94eb3e0c6264 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:51.101224 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5a310a6c-03b8-4c72-aa49-a271abee6103 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:51.102622 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5a310a6c-03b8-4c72-aa49-a271abee6103 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:51.109103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5a310a6c-03b8-4c72-aa49-a271abee6103 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:51.109816 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5a310a6c-03b8-4c72-aa49-a271abee6103 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:51.110408 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5a310a6c-03b8-4c72-aa49-a271abee6103 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:51.111115 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a4851921-5ecb-430e-8fdf-94eb3e0c6264 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.234493 Oct 06 12:24:51.111631 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5a310a6c-03b8-4c72-aa49-a271abee6103 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:51.112045 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 165/324] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:50 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:24:51.112500 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5a310a6c-03b8-4c72-aa49-a271abee6103 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:51.112950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5a310a6c-03b8-4c72-aa49-a271abee6103 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:51.176814 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5a310a6c-03b8-4c72-aa49-a271abee6103 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:51.185896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5a310a6c-03b8-4c72-aa49-a271abee6103 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:51.187459 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5a310a6c-03b8-4c72-aa49-a271abee6103 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:51.188617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5a310a6c-03b8-4c72-aa49-a271abee6103 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1332 microversion: 2.20 time: 0.091799 Oct 06 12:24:51.189333 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 160/325] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:24:51 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:24:52.120140 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-85506bd4-70c8-4227-a168-340405a99c23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:52.120736 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-85506bd4-70c8-4227-a168-340405a99c23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:52.127027 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-85506bd4-70c8-4227-a168-340405a99c23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:52.127526 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-85506bd4-70c8-4227-a168-340405a99c23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:52.127970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-85506bd4-70c8-4227-a168-340405a99c23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:52.128654 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-85506bd4-70c8-4227-a168-340405a99c23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:52.129105 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-85506bd4-70c8-4227-a168-340405a99c23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:52.129520 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-85506bd4-70c8-4227-a168-340405a99c23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:52.137259 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-91f701b5-8d58-44ff-9fc8-41eb8347ee7a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:52.137863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-91f701b5-8d58-44ff-9fc8-41eb8347ee7a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:52.143760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91f701b5-8d58-44ff-9fc8-41eb8347ee7a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:52.144242 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91f701b5-8d58-44ff-9fc8-41eb8347ee7a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:52.144669 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91f701b5-8d58-44ff-9fc8-41eb8347ee7a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:52.145355 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91f701b5-8d58-44ff-9fc8-41eb8347ee7a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:52.145808 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91f701b5-8d58-44ff-9fc8-41eb8347ee7a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:52.146252 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91f701b5-8d58-44ff-9fc8-41eb8347ee7a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:52.350664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-85506bd4-70c8-4227-a168-340405a99c23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:52.358639 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-85506bd4-70c8-4227-a168-340405a99c23 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1509 microversion: 2.1 time: 0.243150 Oct 06 12:24:52.359279 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 166/326] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:52 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1509 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:52.364325 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-731c5ca7-4ef1-4067-9e7f-446d9c49bf18 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:52.364929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-731c5ca7-4ef1-4067-9e7f-446d9c49bf18 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:52.374108 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-731c5ca7-4ef1-4067-9e7f-446d9c49bf18 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:52.375802 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-731c5ca7-4ef1-4067-9e7f-446d9c49bf18 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:52.376272 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-731c5ca7-4ef1-4067-9e7f-446d9c49bf18 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:52.377154 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-731c5ca7-4ef1-4067-9e7f-446d9c49bf18 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:52.377828 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-731c5ca7-4ef1-4067-9e7f-446d9c49bf18 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:52.378193 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-731c5ca7-4ef1-4067-9e7f-446d9c49bf18 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:52.390194 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-91f701b5-8d58-44ff-9fc8-41eb8347ee7a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:52.398287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-91f701b5-8d58-44ff-9fc8-41eb8347ee7a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.264848 Oct 06 12:24:52.399937 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 161/327] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:52 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:24:52.447606 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-731c5ca7-4ef1-4067-9e7f-446d9c49bf18 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:52.455898 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-731c5ca7-4ef1-4067-9e7f-446d9c49bf18 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:52.457344 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-731c5ca7-4ef1-4067-9e7f-446d9c49bf18 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:52.458445 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-731c5ca7-4ef1-4067-9e7f-446d9c49bf18 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1332 microversion: 2.20 time: 0.098060 Oct 06 12:24:52.458998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 167/328] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:24:52 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:24:53.382513 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7dc1bbe9-9c48-4f8f-b839-a3408624a3ec tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:53.383115 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7dc1bbe9-9c48-4f8f-b839-a3408624a3ec tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:53.389593 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7dc1bbe9-9c48-4f8f-b839-a3408624a3ec tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:53.390098 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7dc1bbe9-9c48-4f8f-b839-a3408624a3ec tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:53.390589 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7dc1bbe9-9c48-4f8f-b839-a3408624a3ec tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:53.391419 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7dc1bbe9-9c48-4f8f-b839-a3408624a3ec tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:53.391896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7dc1bbe9-9c48-4f8f-b839-a3408624a3ec tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:53.392324 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7dc1bbe9-9c48-4f8f-b839-a3408624a3ec tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:53.424260 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ce06dc08-a53b-4469-a4d9-b008c75a3852 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:53.424899 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ce06dc08-a53b-4469-a4d9-b008c75a3852 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:53.432202 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ce06dc08-a53b-4469-a4d9-b008c75a3852 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:53.432652 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ce06dc08-a53b-4469-a4d9-b008c75a3852 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:53.433055 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ce06dc08-a53b-4469-a4d9-b008c75a3852 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:53.433832 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ce06dc08-a53b-4469-a4d9-b008c75a3852 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:53.434263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ce06dc08-a53b-4469-a4d9-b008c75a3852 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:53.434691 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ce06dc08-a53b-4469-a4d9-b008c75a3852 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:53.599160 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7dc1bbe9-9c48-4f8f-b839-a3408624a3ec tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:53.609292 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7dc1bbe9-9c48-4f8f-b839-a3408624a3ec tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1509 microversion: 2.1 time: 0.231051 Oct 06 12:24:53.609899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 162/329] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:53 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:24:53.614543 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4b395f43-2d92-4a22-ad71-7624e61e9da9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:53.615481 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4b395f43-2d92-4a22-ad71-7624e61e9da9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:53.621486 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b395f43-2d92-4a22-ad71-7624e61e9da9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:53.621971 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b395f43-2d92-4a22-ad71-7624e61e9da9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:53.622450 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b395f43-2d92-4a22-ad71-7624e61e9da9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:53.623324 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b395f43-2d92-4a22-ad71-7624e61e9da9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:53.623966 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b395f43-2d92-4a22-ad71-7624e61e9da9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:53.625387 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b395f43-2d92-4a22-ad71-7624e61e9da9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:53.639238 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ce06dc08-a53b-4469-a4d9-b008c75a3852 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:53.648471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ce06dc08-a53b-4469-a4d9-b008c75a3852 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.231084 Oct 06 12:24:53.661101 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 168/330] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:53 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:53.705920 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4b395f43-2d92-4a22-ad71-7624e61e9da9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:53.716237 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4b395f43-2d92-4a22-ad71-7624e61e9da9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:53.717778 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4b395f43-2d92-4a22-ad71-7624e61e9da9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:53.718934 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4b395f43-2d92-4a22-ad71-7624e61e9da9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1332 microversion: 2.20 time: 0.108122 Oct 06 12:24:53.719587 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 163/331] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:24:53 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:24:54.633502 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ee16e889-d754-4fb0-9c32-db51b201defb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:54.634119 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ee16e889-d754-4fb0-9c32-db51b201defb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:54.636518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:54.641566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee16e889-d754-4fb0-9c32-db51b201defb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:54.642058 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee16e889-d754-4fb0-9c32-db51b201defb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:54.642490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee16e889-d754-4fb0-9c32-db51b201defb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:54.643186 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee16e889-d754-4fb0-9c32-db51b201defb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:54.643672 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee16e889-d754-4fb0-9c32-db51b201defb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:54.644102 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee16e889-d754-4fb0-9c32-db51b201defb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:54.673442 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9260cd68-5521-44c8-8081-65c1a5824aed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:54.674321 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9260cd68-5521-44c8-8081-65c1a5824aed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:54.680637 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9260cd68-5521-44c8-8081-65c1a5824aed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:54.681120 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9260cd68-5521-44c8-8081-65c1a5824aed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:54.681632 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9260cd68-5521-44c8-8081-65c1a5824aed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:54.682493 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9260cd68-5521-44c8-8081-65c1a5824aed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:54.682940 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9260cd68-5521-44c8-8081-65c1a5824aed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:54.683633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9260cd68-5521-44c8-8081-65c1a5824aed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:54.897476 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ee16e889-d754-4fb0-9c32-db51b201defb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:54.906674 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ee16e889-d754-4fb0-9c32-db51b201defb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1509 microversion: 2.1 time: 0.276951 Oct 06 12:24:54.907933 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 169/332] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:54 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1509 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:54.926193 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-38f1c2f5-67c3-4ed9-abc2-5eb91f569962 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:54.927179 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-38f1c2f5-67c3-4ed9-abc2-5eb91f569962 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:54.932686 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9260cd68-5521-44c8-8081-65c1a5824aed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:54.934698 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-38f1c2f5-67c3-4ed9-abc2-5eb91f569962 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:54.935190 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-38f1c2f5-67c3-4ed9-abc2-5eb91f569962 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:54.935652 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-38f1c2f5-67c3-4ed9-abc2-5eb91f569962 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:54.936560 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-38f1c2f5-67c3-4ed9-abc2-5eb91f569962 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:54.937018 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-38f1c2f5-67c3-4ed9-abc2-5eb91f569962 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:54.937446 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-38f1c2f5-67c3-4ed9-abc2-5eb91f569962 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:54.941046 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9260cd68-5521-44c8-8081-65c1a5824aed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.271716 Oct 06 12:24:54.941889 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 164/333] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:54 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:55.011892 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-38f1c2f5-67c3-4ed9-abc2-5eb91f569962 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:55.020506 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-38f1c2f5-67c3-4ed9-abc2-5eb91f569962 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:55.022877 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-38f1c2f5-67c3-4ed9-abc2-5eb91f569962 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:55.024647 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-38f1c2f5-67c3-4ed9-abc2-5eb91f569962 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1332 microversion: 2.20 time: 0.113991 Oct 06 12:24:55.025217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 170/334] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:24:54 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:24:55.932065 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-fe7f19aa-74a9-491a-b960-782310309b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:55.933001 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-fe7f19aa-74a9-491a-b960-782310309b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:55.939209 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe7f19aa-74a9-491a-b960-782310309b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:55.939623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe7f19aa-74a9-491a-b960-782310309b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:55.940255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe7f19aa-74a9-491a-b960-782310309b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:55.941119 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe7f19aa-74a9-491a-b960-782310309b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:55.941784 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe7f19aa-74a9-491a-b960-782310309b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:55.942351 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe7f19aa-74a9-491a-b960-782310309b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:55.972968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b91d3662-3150-48b6-bc79-d26614b08dec tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:55.974229 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b91d3662-3150-48b6-bc79-d26614b08dec tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:55.998695 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b91d3662-3150-48b6-bc79-d26614b08dec tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:56.000447 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b91d3662-3150-48b6-bc79-d26614b08dec tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:56.001182 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b91d3662-3150-48b6-bc79-d26614b08dec tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:56.002022 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b91d3662-3150-48b6-bc79-d26614b08dec tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:56.002596 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b91d3662-3150-48b6-bc79-d26614b08dec tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:56.003133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b91d3662-3150-48b6-bc79-d26614b08dec tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:56.145201 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fe7f19aa-74a9-491a-b960-782310309b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:56.154955 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-fe7f19aa-74a9-491a-b960-782310309b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1509 microversion: 2.1 time: 0.227356 Oct 06 12:24:56.155561 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 165/335] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:55 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1509 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:56.160501 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-926f1558-cf54-4fbd-b67d-650353661e34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:56.161100 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-926f1558-cf54-4fbd-b67d-650353661e34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:56.167542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-926f1558-cf54-4fbd-b67d-650353661e34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:56.168148 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-926f1558-cf54-4fbd-b67d-650353661e34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:56.168661 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-926f1558-cf54-4fbd-b67d-650353661e34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:56.169275 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-926f1558-cf54-4fbd-b67d-650353661e34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:56.169721 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-926f1558-cf54-4fbd-b67d-650353661e34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:56.170139 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-926f1558-cf54-4fbd-b67d-650353661e34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:56.205619 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b91d3662-3150-48b6-bc79-d26614b08dec tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:56.214159 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b91d3662-3150-48b6-bc79-d26614b08dec tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.248490 Oct 06 12:24:56.215071 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 171/336] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:55 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:56.233344 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-926f1558-cf54-4fbd-b67d-650353661e34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:56.241598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-926f1558-cf54-4fbd-b67d-650353661e34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:56.243151 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-926f1558-cf54-4fbd-b67d-650353661e34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:56.244278 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-926f1558-cf54-4fbd-b67d-650353661e34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1332 microversion: 2.20 time: 0.087795 Oct 06 12:24:56.244828 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 166/337] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:24:56 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:24:57.179720 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-70a372e2-783c-474f-ad77-bbd0e71392c7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:57.180344 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-70a372e2-783c-474f-ad77-bbd0e71392c7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:57.187704 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70a372e2-783c-474f-ad77-bbd0e71392c7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:57.187856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70a372e2-783c-474f-ad77-bbd0e71392c7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:57.188287 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70a372e2-783c-474f-ad77-bbd0e71392c7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:57.188989 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70a372e2-783c-474f-ad77-bbd0e71392c7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:57.189440 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70a372e2-783c-474f-ad77-bbd0e71392c7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:57.189860 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70a372e2-783c-474f-ad77-bbd0e71392c7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:57.239830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-23ac7e7f-57eb-4c0d-a2a3-dd35f027d606 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:57.241645 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-23ac7e7f-57eb-4c0d-a2a3-dd35f027d606 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:57.250080 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23ac7e7f-57eb-4c0d-a2a3-dd35f027d606 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:57.250606 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23ac7e7f-57eb-4c0d-a2a3-dd35f027d606 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:57.251039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23ac7e7f-57eb-4c0d-a2a3-dd35f027d606 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:57.251774 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23ac7e7f-57eb-4c0d-a2a3-dd35f027d606 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:57.252337 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23ac7e7f-57eb-4c0d-a2a3-dd35f027d606 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:57.252760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23ac7e7f-57eb-4c0d-a2a3-dd35f027d606 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:57.276528 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=100 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:57.380126 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-70a372e2-783c-474f-ad77-bbd0e71392c7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:57.391282 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-70a372e2-783c-474f-ad77-bbd0e71392c7 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1509 microversion: 2.1 time: 0.216700 Oct 06 12:24:57.392147 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 172/338] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:57 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:57.398793 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-918f32f8-477f-45c3-81c1-43a3e01ef3ea tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:57.399791 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-918f32f8-477f-45c3-81c1-43a3e01ef3ea tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:57.406504 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-918f32f8-477f-45c3-81c1-43a3e01ef3ea tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:57.407639 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-918f32f8-477f-45c3-81c1-43a3e01ef3ea tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:57.408277 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-918f32f8-477f-45c3-81c1-43a3e01ef3ea tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:57.409186 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-918f32f8-477f-45c3-81c1-43a3e01ef3ea tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:57.409851 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-918f32f8-477f-45c3-81c1-43a3e01ef3ea tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:57.410455 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-918f32f8-477f-45c3-81c1-43a3e01ef3ea tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:57.411077 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:57.432877 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=8 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:57.444133 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-23ac7e7f-57eb-4c0d-a2a3-dd35f027d606 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:57.459325 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-23ac7e7f-57eb-4c0d-a2a3-dd35f027d606 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.223093 Oct 06 12:24:57.460219 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 167/339] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:57 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:24:57.483282 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-918f32f8-477f-45c3-81c1-43a3e01ef3ea tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:57.493619 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-918f32f8-477f-45c3-81c1-43a3e01ef3ea tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:57.495062 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-918f32f8-477f-45c3-81c1-43a3e01ef3ea tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:57.496226 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-918f32f8-477f-45c3-81c1-43a3e01ef3ea tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1332 microversion: 2.20 time: 0.102820 Oct 06 12:24:57.496778 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 173/340] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:24:57 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:24:58.418297 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f01e2a93-6c32-441d-83af-a41de2060d18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:58.419532 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f01e2a93-6c32-441d-83af-a41de2060d18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:58.422791 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=12 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:58.426803 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f01e2a93-6c32-441d-83af-a41de2060d18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:58.427417 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f01e2a93-6c32-441d-83af-a41de2060d18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:58.427961 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f01e2a93-6c32-441d-83af-a41de2060d18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:58.428713 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f01e2a93-6c32-441d-83af-a41de2060d18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:58.429229 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f01e2a93-6c32-441d-83af-a41de2060d18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:58.429747 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f01e2a93-6c32-441d-83af-a41de2060d18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:58.483284 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-61b8facd-6434-47e8-bec2-aaa10d911de1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:58.483932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-61b8facd-6434-47e8-bec2-aaa10d911de1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:58.490650 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-61b8facd-6434-47e8-bec2-aaa10d911de1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:58.491691 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-61b8facd-6434-47e8-bec2-aaa10d911de1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:58.491691 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-61b8facd-6434-47e8-bec2-aaa10d911de1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:58.492287 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-61b8facd-6434-47e8-bec2-aaa10d911de1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:58.492745 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-61b8facd-6434-47e8-bec2-aaa10d911de1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:58.493171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-61b8facd-6434-47e8-bec2-aaa10d911de1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:58.612604 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f01e2a93-6c32-441d-83af-a41de2060d18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:58.620715 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f01e2a93-6c32-441d-83af-a41de2060d18 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1509 microversion: 2.1 time: 0.206070 Oct 06 12:24:58.636110 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 168/341] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:58 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:24:58.641123 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7a900d4f-1117-451f-9382-bed766135cad tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:58.642991 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7a900d4f-1117-451f-9382-bed766135cad tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:58.650458 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7a900d4f-1117-451f-9382-bed766135cad tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:58.651042 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7a900d4f-1117-451f-9382-bed766135cad tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:58.651602 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7a900d4f-1117-451f-9382-bed766135cad tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:58.652395 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7a900d4f-1117-451f-9382-bed766135cad tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:58.653065 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7a900d4f-1117-451f-9382-bed766135cad tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:58.653694 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7a900d4f-1117-451f-9382-bed766135cad tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:58.659910 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-61b8facd-6434-47e8-bec2-aaa10d911de1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:58.663236 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:58.668229 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-61b8facd-6434-47e8-bec2-aaa10d911de1 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.188691 Oct 06 12:24:58.669200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 174/342] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:58 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:24:58.720222 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7a900d4f-1117-451f-9382-bed766135cad tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:58.729528 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7a900d4f-1117-451f-9382-bed766135cad tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:58.731154 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7a900d4f-1117-451f-9382-bed766135cad tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:24:58.732203 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7a900d4f-1117-451f-9382-bed766135cad tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1332 microversion: 2.20 time: 0.094910 Oct 06 12:24:58.732761 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 169/343] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:24:58 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:24:59.652360 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-96f8e2a9-2249-4467-b9a5-d4775a3005f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:59.652987 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-96f8e2a9-2249-4467-b9a5-d4775a3005f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:59.660754 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-96f8e2a9-2249-4467-b9a5-d4775a3005f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:59.661812 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-96f8e2a9-2249-4467-b9a5-d4775a3005f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:59.661812 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-96f8e2a9-2249-4467-b9a5-d4775a3005f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:59.663101 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-96f8e2a9-2249-4467-b9a5-d4775a3005f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:59.663595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-96f8e2a9-2249-4467-b9a5-d4775a3005f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:59.664033 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-96f8e2a9-2249-4467-b9a5-d4775a3005f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:59.691938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4690b1b5-924a-49a6-91b7-dadd7af1717b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:24:59.693348 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4690b1b5-924a-49a6-91b7-dadd7af1717b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:24:59.699591 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4690b1b5-924a-49a6-91b7-dadd7af1717b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:59.700332 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4690b1b5-924a-49a6-91b7-dadd7af1717b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:59.700766 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4690b1b5-924a-49a6-91b7-dadd7af1717b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:24:59.701460 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4690b1b5-924a-49a6-91b7-dadd7af1717b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:24:59.701907 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4690b1b5-924a-49a6-91b7-dadd7af1717b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:24:59.702326 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4690b1b5-924a-49a6-91b7-dadd7af1717b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:00.014864 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-96f8e2a9-2249-4467-b9a5-d4775a3005f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:00.020984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4690b1b5-924a-49a6-91b7-dadd7af1717b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:00.024747 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-96f8e2a9-2249-4467-b9a5-d4775a3005f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1509 microversion: 2.1 time: 0.378523 Oct 06 12:25:00.025373 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 175/344] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:59 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1509 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:00.030123 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f8990ed3-e5ec-40fe-bc6d-f91cc4b70fb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:00.030746 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f8990ed3-e5ec-40fe-bc6d-f91cc4b70fb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:00.043452 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8990ed3-e5ec-40fe-bc6d-f91cc4b70fb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:00.044036 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8990ed3-e5ec-40fe-bc6d-f91cc4b70fb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:00.044547 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8990ed3-e5ec-40fe-bc6d-f91cc4b70fb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:00.045848 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8990ed3-e5ec-40fe-bc6d-f91cc4b70fb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:00.046742 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8990ed3-e5ec-40fe-bc6d-f91cc4b70fb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:00.047242 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8990ed3-e5ec-40fe-bc6d-f91cc4b70fb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:00.051581 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4690b1b5-924a-49a6-91b7-dadd7af1717b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.363434 Oct 06 12:25:00.054197 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 170/345] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:24:59 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:00.119528 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f8990ed3-e5ec-40fe-bc6d-f91cc4b70fb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:00.131235 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f8990ed3-e5ec-40fe-bc6d-f91cc4b70fb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:00.133765 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f8990ed3-e5ec-40fe-bc6d-f91cc4b70fb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:00.135407 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f8990ed3-e5ec-40fe-bc6d-f91cc4b70fb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1338 microversion: 2.20 time: 0.109026 Oct 06 12:25:00.136153 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 176/346] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:00 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1338 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:25:01.048382 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-492af490-5399-4db3-a2f5-2920fa29b4d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:01.048980 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-492af490-5399-4db3-a2f5-2920fa29b4d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:01.055634 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-492af490-5399-4db3-a2f5-2920fa29b4d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:01.056123 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-492af490-5399-4db3-a2f5-2920fa29b4d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:01.056635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-492af490-5399-4db3-a2f5-2920fa29b4d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:01.057327 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-492af490-5399-4db3-a2f5-2920fa29b4d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:01.057774 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-492af490-5399-4db3-a2f5-2920fa29b4d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:01.058195 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-492af490-5399-4db3-a2f5-2920fa29b4d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:01.076499 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-95f2a554-1f28-4f63-8d7c-1849c3abe3cb tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:01.077099 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-95f2a554-1f28-4f63-8d7c-1849c3abe3cb tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:01.083339 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95f2a554-1f28-4f63-8d7c-1849c3abe3cb tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:01.083854 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95f2a554-1f28-4f63-8d7c-1849c3abe3cb tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:01.084793 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95f2a554-1f28-4f63-8d7c-1849c3abe3cb tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:01.085491 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95f2a554-1f28-4f63-8d7c-1849c3abe3cb tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:01.085925 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95f2a554-1f28-4f63-8d7c-1849c3abe3cb tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:01.086344 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95f2a554-1f28-4f63-8d7c-1849c3abe3cb tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:01.264566 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-492af490-5399-4db3-a2f5-2920fa29b4d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:01.269638 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-95f2a554-1f28-4f63-8d7c-1849c3abe3cb tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:01.273027 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-492af490-5399-4db3-a2f5-2920fa29b4d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1509 microversion: 2.1 time: 0.228461 Oct 06 12:25:01.274769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 171/347] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:01 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:01.280154 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-863c1e86-4533-4b3a-bd42-991fa61dbcb8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:01.280918 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-863c1e86-4533-4b3a-bd42-991fa61dbcb8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:01.282890 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-95f2a554-1f28-4f63-8d7c-1849c3abe3cb tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.210023 Oct 06 12:25:01.288463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-863c1e86-4533-4b3a-bd42-991fa61dbcb8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:01.289745 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-863c1e86-4533-4b3a-bd42-991fa61dbcb8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:01.290873 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-863c1e86-4533-4b3a-bd42-991fa61dbcb8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:01.291734 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-863c1e86-4533-4b3a-bd42-991fa61dbcb8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:01.292354 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-863c1e86-4533-4b3a-bd42-991fa61dbcb8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:01.292951 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-863c1e86-4533-4b3a-bd42-991fa61dbcb8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:01.296598 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 177/348] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:01 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:01.307277 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-ab10a523-4b0e-4523-83ca-1d62dce49840 req-4d4ae93a-b76a-4ae9-b14d-ac5a41914df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf13a44-e331-4b28-9d44-6890e99df4de", "name": "network-vif-plugged", "status": "completed", "tag": "ecb33657-c68d-4387-95f1-ade395dddf6a"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:01.317244 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-ab10a523-4b0e-4523-83ca-1d62dce49840 req-4d4ae93a-b76a-4ae9-b14d-ac5a41914df6 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:01.318017 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-ab10a523-4b0e-4523-83ca-1d62dce49840 req-4d4ae93a-b76a-4ae9-b14d-ac5a41914df6 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:01.318593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-ab10a523-4b0e-4523-83ca-1d62dce49840 req-4d4ae93a-b76a-4ae9-b14d-ac5a41914df6 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:01.333197 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-ab10a523-4b0e-4523-83ca-1d62dce49840 req-4d4ae93a-b76a-4ae9-b14d-ac5a41914df6 service nova] Creating event network-vif-plugged:ecb33657-c68d-4387-95f1-ade395dddf6a for instance 5bf13a44-e331-4b28-9d44-6890e99df4de on hv-cinder-85604 Oct 06 12:25:01.339881 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-ab10a523-4b0e-4523-83ca-1d62dce49840 req-4d4ae93a-b76a-4ae9-b14d-ac5a41914df6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041620 Oct 06 12:25:01.341095 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 178/349] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:25:01.433283 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-863c1e86-4533-4b3a-bd42-991fa61dbcb8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:01.441312 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-863c1e86-4533-4b3a-bd42-991fa61dbcb8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:01.442744 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-863c1e86-4533-4b3a-bd42-991fa61dbcb8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:01.444347 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-863c1e86-4533-4b3a-bd42-991fa61dbcb8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1405 microversion: 2.20 time: 0.167850 Oct 06 12:25:01.444904 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 172/350] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:01 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:25:02.299131 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-15b23fdd-3dcc-4feb-bdb8-259a84ea8d09 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:02.299865 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-15b23fdd-3dcc-4feb-bdb8-259a84ea8d09 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:02.306772 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-15b23fdd-3dcc-4feb-bdb8-259a84ea8d09 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:02.307356 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-15b23fdd-3dcc-4feb-bdb8-259a84ea8d09 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:02.307819 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-15b23fdd-3dcc-4feb-bdb8-259a84ea8d09 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:02.308527 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-15b23fdd-3dcc-4feb-bdb8-259a84ea8d09 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:02.308984 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-15b23fdd-3dcc-4feb-bdb8-259a84ea8d09 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:02.309408 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-15b23fdd-3dcc-4feb-bdb8-259a84ea8d09 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:02.309815 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a90f8180-d6f3-4f31-961e-4539c04047df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:02.310417 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a90f8180-d6f3-4f31-961e-4539c04047df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:02.316355 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a90f8180-d6f3-4f31-961e-4539c04047df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:02.316901 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a90f8180-d6f3-4f31-961e-4539c04047df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:02.317335 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a90f8180-d6f3-4f31-961e-4539c04047df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:02.318010 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a90f8180-d6f3-4f31-961e-4539c04047df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:02.318462 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a90f8180-d6f3-4f31-961e-4539c04047df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:02.318870 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a90f8180-d6f3-4f31-961e-4539c04047df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:02.524630 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a90f8180-d6f3-4f31-961e-4539c04047df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:02.528325 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-15b23fdd-3dcc-4feb-bdb8-259a84ea8d09 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:02.532826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a90f8180-d6f3-4f31-961e-4539c04047df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.226611 Oct 06 12:25:02.536230 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-15b23fdd-3dcc-4feb-bdb8-259a84ea8d09 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1509 microversion: 2.1 time: 0.241659 Oct 06 12:25:02.548338 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 179/351] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:02 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1509 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:02.558833 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f04e63b1-3249-411c-8ffd-f57b42aaa234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:02.559455 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f04e63b1-3249-411c-8ffd-f57b42aaa234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:02.560051 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 173/352] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:02 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:02.565641 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f04e63b1-3249-411c-8ffd-f57b42aaa234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:02.566138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f04e63b1-3249-411c-8ffd-f57b42aaa234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:02.566575 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f04e63b1-3249-411c-8ffd-f57b42aaa234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:02.567275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f04e63b1-3249-411c-8ffd-f57b42aaa234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:02.567773 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f04e63b1-3249-411c-8ffd-f57b42aaa234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:02.568207 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f04e63b1-3249-411c-8ffd-f57b42aaa234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:02.869065 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f04e63b1-3249-411c-8ffd-f57b42aaa234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:02.878894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f04e63b1-3249-411c-8ffd-f57b42aaa234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:02.880718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f04e63b1-3249-411c-8ffd-f57b42aaa234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:02.882050 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f04e63b1-3249-411c-8ffd-f57b42aaa234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1405 microversion: 2.20 time: 0.332453 Oct 06 12:25:02.882799 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 180/353] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:02 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1405 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:25:03.352838 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-c809c4a1-f3f3-49b6-aed7-dfab6f49337e req-80df8a0d-cd18-447f-a523-ee3ff2163a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b1825b8-e10c-4c5b-adf9-3456c97a68e2", "tag": "178adb30-0da6-4996-903a-4ee020de2a0a"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:03.362978 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-c809c4a1-f3f3-49b6-aed7-dfab6f49337e req-80df8a0d-cd18-447f-a523-ee3ff2163a20 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:03.364111 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-c809c4a1-f3f3-49b6-aed7-dfab6f49337e req-80df8a0d-cd18-447f-a523-ee3ff2163a20 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:03.364957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-c809c4a1-f3f3-49b6-aed7-dfab6f49337e req-80df8a0d-cd18-447f-a523-ee3ff2163a20 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:03.378872 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-c809c4a1-f3f3-49b6-aed7-dfab6f49337e req-80df8a0d-cd18-447f-a523-ee3ff2163a20 service nova] Creating event network-changed:178adb30-0da6-4996-903a-4ee020de2a0a for instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 on hv-cinder-85604 Oct 06 12:25:03.384805 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-c809c4a1-f3f3-49b6-aed7-dfab6f49337e req-80df8a0d-cd18-447f-a523-ee3ff2163a20 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035601 Oct 06 12:25:03.385767 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 174/354] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:25:03.563088 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-298472b1-53ae-4dd9-bfb6-9667cc73fec9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:03.564821 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-298472b1-53ae-4dd9-bfb6-9667cc73fec9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:03.567287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-33cf725f-d198-42df-801b-bde37e4803de tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:03.568022 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-33cf725f-d198-42df-801b-bde37e4803de tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:03.573173 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-298472b1-53ae-4dd9-bfb6-9667cc73fec9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:03.573670 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-298472b1-53ae-4dd9-bfb6-9667cc73fec9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:03.574302 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-298472b1-53ae-4dd9-bfb6-9667cc73fec9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:03.575298 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-298472b1-53ae-4dd9-bfb6-9667cc73fec9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:03.575992 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-298472b1-53ae-4dd9-bfb6-9667cc73fec9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:03.576584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-298472b1-53ae-4dd9-bfb6-9667cc73fec9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:03.577860 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-33cf725f-d198-42df-801b-bde37e4803de tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:03.578579 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-33cf725f-d198-42df-801b-bde37e4803de tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:03.579021 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-33cf725f-d198-42df-801b-bde37e4803de tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:03.580006 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-33cf725f-d198-42df-801b-bde37e4803de tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:03.580822 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-33cf725f-d198-42df-801b-bde37e4803de tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:03.581492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-33cf725f-d198-42df-801b-bde37e4803de tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:04.081834 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-298472b1-53ae-4dd9-bfb6-9667cc73fec9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:04.085546 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-33cf725f-d198-42df-801b-bde37e4803de tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:04.090088 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-298472b1-53ae-4dd9-bfb6-9667cc73fec9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.533315 Oct 06 12:25:04.090966 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 181/355] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:03 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:04.093639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-33cf725f-d198-42df-801b-bde37e4803de tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1515 microversion: 2.1 time: 0.532086 Oct 06 12:25:04.094527 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 175/356] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:03 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1515 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:04.096046 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8d43d95b-bec3-41d7-913c-73295d48d3a9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:04.096755 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8d43d95b-bec3-41d7-913c-73295d48d3a9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:04.103497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8d43d95b-bec3-41d7-913c-73295d48d3a9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:04.104014 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8d43d95b-bec3-41d7-913c-73295d48d3a9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:04.104451 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8d43d95b-bec3-41d7-913c-73295d48d3a9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:04.105147 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8d43d95b-bec3-41d7-913c-73295d48d3a9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:04.105605 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8d43d95b-bec3-41d7-913c-73295d48d3a9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:04.106033 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8d43d95b-bec3-41d7-913c-73295d48d3a9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:04.389330 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8d43d95b-bec3-41d7-913c-73295d48d3a9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:04.408565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8d43d95b-bec3-41d7-913c-73295d48d3a9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:04.410024 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8d43d95b-bec3-41d7-913c-73295d48d3a9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:04.411220 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8d43d95b-bec3-41d7-913c-73295d48d3a9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1405 microversion: 2.20 time: 0.319540 Oct 06 12:25:04.411962 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 182/357] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:04 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1405 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:25:05.113987 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ede077ef-efd7-4131-86c3-98e4b2b539ac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:05.115853 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ede077ef-efd7-4131-86c3-98e4b2b539ac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:05.122264 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ede077ef-efd7-4131-86c3-98e4b2b539ac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:05.123024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ede077ef-efd7-4131-86c3-98e4b2b539ac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:05.123681 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ede077ef-efd7-4131-86c3-98e4b2b539ac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:05.124610 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ede077ef-efd7-4131-86c3-98e4b2b539ac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:05.125277 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ede077ef-efd7-4131-86c3-98e4b2b539ac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:05.126060 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ede077ef-efd7-4131-86c3-98e4b2b539ac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:05.372333 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ede077ef-efd7-4131-86c3-98e4b2b539ac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:05.380385 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ede077ef-efd7-4131-86c3-98e4b2b539ac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1314 microversion: 2.1 time: 0.270478 Oct 06 12:25:05.380974 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 176/358] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:05 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:05.436281 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3ccd76df-92c5-462b-a18a-b737f00df6a7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:05.437438 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3ccd76df-92c5-462b-a18a-b737f00df6a7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:05.455986 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3ccd76df-92c5-462b-a18a-b737f00df6a7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:05.455986 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3ccd76df-92c5-462b-a18a-b737f00df6a7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:05.455986 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3ccd76df-92c5-462b-a18a-b737f00df6a7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:05.455986 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3ccd76df-92c5-462b-a18a-b737f00df6a7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:05.456281 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3ccd76df-92c5-462b-a18a-b737f00df6a7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:05.456281 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3ccd76df-92c5-462b-a18a-b737f00df6a7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:05.584367 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3ccd76df-92c5-462b-a18a-b737f00df6a7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:05.592988 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3ccd76df-92c5-462b-a18a-b737f00df6a7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:05.594438 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3ccd76df-92c5-462b-a18a-b737f00df6a7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:05.595577 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3ccd76df-92c5-462b-a18a-b737f00df6a7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1405 microversion: 2.20 time: 0.163369 Oct 06 12:25:05.596133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 183/359] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:05 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:25:06.403475 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9085c46b-5fd7-4bd2-93f9-d83aaaddafe3 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:06.404993 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9085c46b-5fd7-4bd2-93f9-d83aaaddafe3 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:06.412858 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9085c46b-5fd7-4bd2-93f9-d83aaaddafe3 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:06.413336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9085c46b-5fd7-4bd2-93f9-d83aaaddafe3 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:06.413761 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9085c46b-5fd7-4bd2-93f9-d83aaaddafe3 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:06.414570 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9085c46b-5fd7-4bd2-93f9-d83aaaddafe3 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:06.415348 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9085c46b-5fd7-4bd2-93f9-d83aaaddafe3 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:06.416093 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9085c46b-5fd7-4bd2-93f9-d83aaaddafe3 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:06.579692 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5f008e97-3243-415e-8abc-eda5d2137345 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Action: 'create', calling method: .version_select at 0x7f03aaeb3d30>, body: {"keypair": {"name": "tempest-keypair-89683590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDDgtBIg8bAiP6t47WQyqk9AXyCIfd0UxYrp+sZMLMv+liceG1KOAPje2DlQRNfFloKNh+Zfk3mILnrLYpT3gb2xR4Dy+cMdiVv5imuwnE0r78K4phyAadQiduNdjvHdg=="}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:06.596463 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-5f008e97-3243-415e-8abc-eda5d2137345 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Getting quotas for project 9138bc89f5204975a18156097530643a. Resources: {'key_pairs'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:25:06.601506 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-5f008e97-3243-415e-8abc-eda5d2137345 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Getting quotas for user 1f4cbe342b2c4378b3c0ab2f1cd55260 and project 9138bc89f5204975a18156097530643a. Resources: {'key_pairs'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:25:06.629105 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5f008e97-3243-415e-8abc-eda5d2137345 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.053083 Oct 06 12:25:06.629845 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 184/360] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 12:25:06 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:25:06.634662 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-53c0bb1a-e851-4192-8073-96f289f5e765 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:06.635588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-53c0bb1a-e851-4192-8073-96f289f5e765 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:06.641363 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53c0bb1a-e851-4192-8073-96f289f5e765 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:06.641854 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53c0bb1a-e851-4192-8073-96f289f5e765 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:06.642365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53c0bb1a-e851-4192-8073-96f289f5e765 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:06.643096 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53c0bb1a-e851-4192-8073-96f289f5e765 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:06.643774 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53c0bb1a-e851-4192-8073-96f289f5e765 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:06.644259 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-53c0bb1a-e851-4192-8073-96f289f5e765 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:06.786305 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9085c46b-5fd7-4bd2-93f9-d83aaaddafe3 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:06.797041 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9085c46b-5fd7-4bd2-93f9-d83aaaddafe3 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1498 microversion: 2.1 time: 0.397376 Oct 06 12:25:06.797753 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 177/361] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:06 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1498 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:06.876030 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-53c0bb1a-e851-4192-8073-96f289f5e765 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:06.886121 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-53c0bb1a-e851-4192-8073-96f289f5e765 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:06.888183 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-53c0bb1a-e851-4192-8073-96f289f5e765 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:06.889493 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-53c0bb1a-e851-4192-8073-96f289f5e765 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1405 microversion: 2.20 time: 0.258424 Oct 06 12:25:06.890438 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 185/362] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:06 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:25:07.444692 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a0c19ed6-82cb-470d-8a11-6f7d069ab13a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:07.445232 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a0c19ed6-82cb-470d-8a11-6f7d069ab13a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:07.451165 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a0c19ed6-82cb-470d-8a11-6f7d069ab13a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:07.451747 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a0c19ed6-82cb-470d-8a11-6f7d069ab13a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:07.452242 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a0c19ed6-82cb-470d-8a11-6f7d069ab13a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:07.452992 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a0c19ed6-82cb-470d-8a11-6f7d069ab13a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:07.453521 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a0c19ed6-82cb-470d-8a11-6f7d069ab13a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:07.454053 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a0c19ed6-82cb-470d-8a11-6f7d069ab13a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:07.480616 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a0c19ed6-82cb-470d-8a11-6f7d069ab13a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Going to try to terminate instance {{(pid=120509) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:25:07.575958 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a0c19ed6-82cb-470d-8a11-6f7d069ab13a tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 204 len: 0 microversion: 2.1 time: 0.135518 Oct 06 12:25:07.579792 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 178/363] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:25:07 2022] DELETE /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:25:07.585716 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8ca0a641-46f3-4221-a750-06b1a3e56db8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:07.586900 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8ca0a641-46f3-4221-a750-06b1a3e56db8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:07.593717 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8ca0a641-46f3-4221-a750-06b1a3e56db8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:07.594202 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8ca0a641-46f3-4221-a750-06b1a3e56db8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:07.594636 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8ca0a641-46f3-4221-a750-06b1a3e56db8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:07.595334 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8ca0a641-46f3-4221-a750-06b1a3e56db8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:07.595948 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8ca0a641-46f3-4221-a750-06b1a3e56db8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:07.596374 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8ca0a641-46f3-4221-a750-06b1a3e56db8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:07.748726 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8ca0a641-46f3-4221-a750-06b1a3e56db8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:07.757756 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8ca0a641-46f3-4221-a750-06b1a3e56db8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1504 microversion: 2.1 time: 0.175871 Oct 06 12:25:07.767947 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 186/364] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:07 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:07.916917 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9c0d27fd-b2b7-4db5-8317-94654b9676ac tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:07.919195 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9c0d27fd-b2b7-4db5-8317-94654b9676ac tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:07.926623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9c0d27fd-b2b7-4db5-8317-94654b9676ac tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:07.928167 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9c0d27fd-b2b7-4db5-8317-94654b9676ac tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:07.928796 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9c0d27fd-b2b7-4db5-8317-94654b9676ac tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:07.929695 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9c0d27fd-b2b7-4db5-8317-94654b9676ac tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:07.930157 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9c0d27fd-b2b7-4db5-8317-94654b9676ac tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:07.931119 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9c0d27fd-b2b7-4db5-8317-94654b9676ac tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:08.114241 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9c0d27fd-b2b7-4db5-8317-94654b9676ac tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:08.123740 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9c0d27fd-b2b7-4db5-8317-94654b9676ac tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:08.125479 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9c0d27fd-b2b7-4db5-8317-94654b9676ac tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:08.126895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9c0d27fd-b2b7-4db5-8317-94654b9676ac tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1405 microversion: 2.20 time: 0.214913 Oct 06 12:25:08.128320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 179/365] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:07 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:25:08.302290 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1920991695", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cca2176c-b240-4d92-a159-a5d2161a7a8d"}], "security_groups": [{"name": "tempest-securitygroup--1820902106"}], "key_name": "tempest-keypair-89683590", "user_data": "}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:08.437605 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.network.neutron [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] validate_networks() for [('cca2176c-b240-4d92-a159-a5d2161a7a8d', None, None, None, None, None)] {{(pid=120508) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:25:08.781464 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8ec58943-006d-48b0-9bbb-a1120dc9d5d9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:08.782326 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8ec58943-006d-48b0-9bbb-a1120dc9d5d9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:08.789499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8ec58943-006d-48b0-9bbb-a1120dc9d5d9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:08.789983 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8ec58943-006d-48b0-9bbb-a1120dc9d5d9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:08.790407 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8ec58943-006d-48b0-9bbb-a1120dc9d5d9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:08.791094 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8ec58943-006d-48b0-9bbb-a1120dc9d5d9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:08.791557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8ec58943-006d-48b0-9bbb-a1120dc9d5d9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:08.791983 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8ec58943-006d-48b0-9bbb-a1120dc9d5d9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:09.163695 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8ec58943-006d-48b0-9bbb-a1120dc9d5d9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:09.171367 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8ec58943-006d-48b0-9bbb-a1120dc9d5d9 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1504 microversion: 2.1 time: 0.393858 Oct 06 12:25:09.171973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 180/366] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:08 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1504 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:09.176710 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7840bc78-775c-40e0-8a07-ed8bda2be583 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:09.177487 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7840bc78-775c-40e0-8a07-ed8bda2be583 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:09.183428 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7840bc78-775c-40e0-8a07-ed8bda2be583 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:09.184088 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7840bc78-775c-40e0-8a07-ed8bda2be583 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:09.184654 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7840bc78-775c-40e0-8a07-ed8bda2be583 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:09.185557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7840bc78-775c-40e0-8a07-ed8bda2be583 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:09.186168 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7840bc78-775c-40e0-8a07-ed8bda2be583 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:09.186721 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7840bc78-775c-40e0-8a07-ed8bda2be583 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:09.491341 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Flavor limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:25:09.492168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Image limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:25:09.493563 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Flavor pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:25:09.494269 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Image pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:25:09.494716 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:25:09.509558 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:09.510237 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:09.510880 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:09.511883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:09.512748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:09.513375 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:09.532995 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Getting quotas for project 9138bc89f5204975a18156097530643a. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:25:09.538034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Getting quotas for user 1f4cbe342b2c4378b3c0ab2f1cd55260 and project 9138bc89f5204975a18156097530643a. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:25:09.551263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Going to run 1 instances... {{(pid=120508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:25:09.554188 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:25:09.605581 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7840bc78-775c-40e0-8a07-ed8bda2be583 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:09.615893 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7840bc78-775c-40e0-8a07-ed8bda2be583 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:09.622020 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7840bc78-775c-40e0-8a07-ed8bda2be583 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:09.626335 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7840bc78-775c-40e0-8a07-ed8bda2be583 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1405 microversion: 2.20 time: 0.453179 Oct 06 12:25:09.627467 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 181/367] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:09 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:25:09.636940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f2295449-0cf1-4c85-96e3-8ee32b5fa591 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.339465 Oct 06 12:25:09.649874 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b1618e98-cb00-400f-8d7d-f8abbca94605 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:09.651187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b1618e98-cb00-400f-8d7d-f8abbca94605 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:09.656756 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 187/368] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:25:08 2022] POST /compute/v2.1/servers => generated 409 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:25:09.803700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b1618e98-cb00-400f-8d7d-f8abbca94605 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:09.815236 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b1618e98-cb00-400f-8d7d-f8abbca94605 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1244 microversion: 2.1 time: 0.167337 Oct 06 12:25:09.829256 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 182/369] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:09 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1244 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:10.197778 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2fc2d2d4-e8de-4081-9f93-5a7fcff18e14 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:10.198546 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2fc2d2d4-e8de-4081-9f93-5a7fcff18e14 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:10.218252 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2fc2d2d4-e8de-4081-9f93-5a7fcff18e14 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:10.220210 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2fc2d2d4-e8de-4081-9f93-5a7fcff18e14 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:10.220756 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2fc2d2d4-e8de-4081-9f93-5a7fcff18e14 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:10.227822 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2fc2d2d4-e8de-4081-9f93-5a7fcff18e14 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:10.230691 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2fc2d2d4-e8de-4081-9f93-5a7fcff18e14 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:10.231169 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2fc2d2d4-e8de-4081-9f93-5a7fcff18e14 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:10.426065 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2fc2d2d4-e8de-4081-9f93-5a7fcff18e14 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:10.442652 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2fc2d2d4-e8de-4081-9f93-5a7fcff18e14 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1504 microversion: 2.1 time: 0.250064 Oct 06 12:25:10.443884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 188/370] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:10 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1504 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:10.653104 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7fab7446-2107-49ed-be51-a2c8e28b705f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:10.653815 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7fab7446-2107-49ed-be51-a2c8e28b705f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:10.673130 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7fab7446-2107-49ed-be51-a2c8e28b705f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:10.673994 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7fab7446-2107-49ed-be51-a2c8e28b705f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:10.674683 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7fab7446-2107-49ed-be51-a2c8e28b705f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:10.675953 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7fab7446-2107-49ed-be51-a2c8e28b705f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:10.676649 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7fab7446-2107-49ed-be51-a2c8e28b705f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:10.677284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7fab7446-2107-49ed-be51-a2c8e28b705f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:10.843880 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0f22bfe5-0fb3-44eb-aba0-ae0a039a2521 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:10.844826 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-0f22bfe5-0fb3-44eb-aba0-ae0a039a2521 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:10.854170 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0f22bfe5-0fb3-44eb-aba0-ae0a039a2521 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:10.854933 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0f22bfe5-0fb3-44eb-aba0-ae0a039a2521 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:10.855986 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0f22bfe5-0fb3-44eb-aba0-ae0a039a2521 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:10.856964 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0f22bfe5-0fb3-44eb-aba0-ae0a039a2521 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:10.858215 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0f22bfe5-0fb3-44eb-aba0-ae0a039a2521 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:10.858708 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0f22bfe5-0fb3-44eb-aba0-ae0a039a2521 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:10.882038 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7fab7446-2107-49ed-be51-a2c8e28b705f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:10.893185 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7fab7446-2107-49ed-be51-a2c8e28b705f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:10.895277 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7fab7446-2107-49ed-be51-a2c8e28b705f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:10.897249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7fab7446-2107-49ed-be51-a2c8e28b705f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1405 microversion: 2.20 time: 0.248666 Oct 06 12:25:10.898552 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 183/371] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:10 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1405 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:25:10.961860 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-0f22bfe5-0fb3-44eb-aba0-ae0a039a2521 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:10.975259 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-0f22bfe5-0fb3-44eb-aba0-ae0a039a2521 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1248 microversion: 2.1 time: 0.136216 Oct 06 12:25:10.976926 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 189/372] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:10 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1248 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:11.469264 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-14cfe13d-9f56-44fd-bc5a-f6ad27985943 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:11.470058 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-14cfe13d-9f56-44fd-bc5a-f6ad27985943 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:11.480198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-14cfe13d-9f56-44fd-bc5a-f6ad27985943 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:11.481578 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-14cfe13d-9f56-44fd-bc5a-f6ad27985943 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:11.483419 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-14cfe13d-9f56-44fd-bc5a-f6ad27985943 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:11.484437 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-14cfe13d-9f56-44fd-bc5a-f6ad27985943 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:11.485557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-14cfe13d-9f56-44fd-bc5a-f6ad27985943 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:11.486209 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-14cfe13d-9f56-44fd-bc5a-f6ad27985943 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:11.493455 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:11.667170 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-14cfe13d-9f56-44fd-bc5a-f6ad27985943 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:11.678762 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-14cfe13d-9f56-44fd-bc5a-f6ad27985943 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1504 microversion: 2.1 time: 0.215058 Oct 06 12:25:11.679869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 184/373] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:11 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:11.924366 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f4882b28-5132-4636-8576-b764debb6cc4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:11.925070 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f4882b28-5132-4636-8576-b764debb6cc4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:11.949419 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4882b28-5132-4636-8576-b764debb6cc4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:11.950800 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4882b28-5132-4636-8576-b764debb6cc4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:11.952144 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4882b28-5132-4636-8576-b764debb6cc4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:11.957604 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4882b28-5132-4636-8576-b764debb6cc4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:11.958773 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4882b28-5132-4636-8576-b764debb6cc4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:11.960306 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4882b28-5132-4636-8576-b764debb6cc4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:12.001780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-fbbf27c4-89ad-43f4-b1e0-44882c7cbbb1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:12.002421 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-fbbf27c4-89ad-43f4-b1e0-44882c7cbbb1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:12.013611 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbbf27c4-89ad-43f4-b1e0-44882c7cbbb1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:12.014099 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbbf27c4-89ad-43f4-b1e0-44882c7cbbb1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:12.014534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbbf27c4-89ad-43f4-b1e0-44882c7cbbb1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:12.026020 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbbf27c4-89ad-43f4-b1e0-44882c7cbbb1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:12.026619 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbbf27c4-89ad-43f4-b1e0-44882c7cbbb1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:12.027067 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbbf27c4-89ad-43f4-b1e0-44882c7cbbb1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:12.283294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fbbf27c4-89ad-43f4-b1e0-44882c7cbbb1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:12.294462 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-fbbf27c4-89ad-43f4-b1e0-44882c7cbbb1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1240 microversion: 2.1 time: 0.298429 Oct 06 12:25:12.296083 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 185/374] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:11 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1240 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:12.407491 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f4882b28-5132-4636-8576-b764debb6cc4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:12.440925 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f4882b28-5132-4636-8576-b764debb6cc4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:12.442583 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f4882b28-5132-4636-8576-b764debb6cc4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:12.444489 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f4882b28-5132-4636-8576-b764debb6cc4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1405 microversion: 2.20 time: 0.525096 Oct 06 12:25:12.445296 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 190/375] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:11 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1405 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:25:12.705329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5b45f5d5-4664-4445-86c6-f2dfbf9ce4a8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:12.706257 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5b45f5d5-4664-4445-86c6-f2dfbf9ce4a8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:12.721659 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b45f5d5-4664-4445-86c6-f2dfbf9ce4a8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:12.724829 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b45f5d5-4664-4445-86c6-f2dfbf9ce4a8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:12.725496 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b45f5d5-4664-4445-86c6-f2dfbf9ce4a8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:12.727160 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b45f5d5-4664-4445-86c6-f2dfbf9ce4a8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:12.728710 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b45f5d5-4664-4445-86c6-f2dfbf9ce4a8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:12.733323 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b45f5d5-4664-4445-86c6-f2dfbf9ce4a8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:13.162096 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5b45f5d5-4664-4445-86c6-f2dfbf9ce4a8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:13.172608 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5b45f5d5-4664-4445-86c6-f2dfbf9ce4a8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1504 microversion: 2.1 time: 0.473771 Oct 06 12:25:13.173891 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 186/376] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:12 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1504 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:13.323918 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-edc7b4f3-afe2-4c05-8e25-0ee03fb378d9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:13.324920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-edc7b4f3-afe2-4c05-8e25-0ee03fb378d9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:13.333391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-edc7b4f3-afe2-4c05-8e25-0ee03fb378d9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:13.334614 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-edc7b4f3-afe2-4c05-8e25-0ee03fb378d9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:13.335107 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-edc7b4f3-afe2-4c05-8e25-0ee03fb378d9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:13.336287 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-edc7b4f3-afe2-4c05-8e25-0ee03fb378d9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:13.336742 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-edc7b4f3-afe2-4c05-8e25-0ee03fb378d9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:13.337324 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-edc7b4f3-afe2-4c05-8e25-0ee03fb378d9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:13.476197 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-348e2388-6fc3-41f3-b73b-45485352ecf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:13.477043 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-348e2388-6fc3-41f3-b73b-45485352ecf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:13.482402 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-edc7b4f3-afe2-4c05-8e25-0ee03fb378d9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:13.490646 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-348e2388-6fc3-41f3-b73b-45485352ecf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:13.493440 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-edc7b4f3-afe2-4c05-8e25-0ee03fb378d9 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1240 microversion: 2.1 time: 0.173781 Oct 06 12:25:13.494593 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-348e2388-6fc3-41f3-b73b-45485352ecf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:13.495416 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-348e2388-6fc3-41f3-b73b-45485352ecf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:13.497932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-348e2388-6fc3-41f3-b73b-45485352ecf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:13.501573 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-348e2388-6fc3-41f3-b73b-45485352ecf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:13.502289 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-348e2388-6fc3-41f3-b73b-45485352ecf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:13.512892 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 191/377] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:13 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1240 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:14.006965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-ab22e53a-66fd-4ebb-a3f4-47baa977d237 req-05e7d995-8037-46ff-a6cf-718081732df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf13a44-e331-4b28-9d44-6890e99df4de", "name": "network-vif-deleted", "tag": "ecb33657-c68d-4387-95f1-ade395dddf6a"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:14.017988 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-ab22e53a-66fd-4ebb-a3f4-47baa977d237 req-05e7d995-8037-46ff-a6cf-718081732df3 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:14.019145 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-ab22e53a-66fd-4ebb-a3f4-47baa977d237 req-05e7d995-8037-46ff-a6cf-718081732df3 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:14.020807 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-ab22e53a-66fd-4ebb-a3f4-47baa977d237 req-05e7d995-8037-46ff-a6cf-718081732df3 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:14.034107 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-ab22e53a-66fd-4ebb-a3f4-47baa977d237 req-05e7d995-8037-46ff-a6cf-718081732df3 service nova] Creating event network-vif-deleted:ecb33657-c68d-4387-95f1-ade395dddf6a for instance 5bf13a44-e331-4b28-9d44-6890e99df4de on hv-cinder-85604 Oct 06 12:25:14.041153 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-ab22e53a-66fd-4ebb-a3f4-47baa977d237 req-05e7d995-8037-46ff-a6cf-718081732df3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038852 Oct 06 12:25:14.041962 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 192/378] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:25:14.128449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-348e2388-6fc3-41f3-b73b-45485352ecf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:14.138326 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-348e2388-6fc3-41f3-b73b-45485352ecf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:14.140405 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-348e2388-6fc3-41f3-b73b-45485352ecf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:14.141748 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-348e2388-6fc3-41f3-b73b-45485352ecf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1405 microversion: 2.20 time: 0.671386 Oct 06 12:25:14.179212 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 187/379] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:13 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1405 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:25:14.204578 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4b736af0-7b89-4a18-83a6-65c677ffa9cd tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:14.207118 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-4b736af0-7b89-4a18-83a6-65c677ffa9cd tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:14.228900 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4b736af0-7b89-4a18-83a6-65c677ffa9cd tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:14.235869 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4b736af0-7b89-4a18-83a6-65c677ffa9cd tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:14.236433 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4b736af0-7b89-4a18-83a6-65c677ffa9cd tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:14.237328 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4b736af0-7b89-4a18-83a6-65c677ffa9cd tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:14.256981 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4b736af0-7b89-4a18-83a6-65c677ffa9cd tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:14.260102 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4b736af0-7b89-4a18-83a6-65c677ffa9cd tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:14.406923 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4b736af0-7b89-4a18-83a6-65c677ffa9cd tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:14.422678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4b736af0-7b89-4a18-83a6-65c677ffa9cd tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1299 microversion: 2.1 time: 0.230148 Oct 06 12:25:14.423267 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 193/380] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:14 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:14.536402 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c55ff49c-4476-4abc-8f6a-ced7db3a0804 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:14.539217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c55ff49c-4476-4abc-8f6a-ced7db3a0804 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:14.562793 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-d12c64b5-fad7-41d5-bb10-b01727f326a3 req-5a4ab729-2135-4d9d-8d40-3f6973f16882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b1825b8-e10c-4c5b-adf9-3456c97a68e2", "name": "network-vif-plugged", "status": "completed", "tag": "178adb30-0da6-4996-903a-4ee020de2a0a"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:14.585792 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-d12c64b5-fad7-41d5-bb10-b01727f326a3 req-5a4ab729-2135-4d9d-8d40-3f6973f16882 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:14.588476 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-d12c64b5-fad7-41d5-bb10-b01727f326a3 req-5a4ab729-2135-4d9d-8d40-3f6973f16882 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:14.589088 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-d12c64b5-fad7-41d5-bb10-b01727f326a3 req-5a4ab729-2135-4d9d-8d40-3f6973f16882 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:14.595633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c55ff49c-4476-4abc-8f6a-ced7db3a0804 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:14.596560 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c55ff49c-4476-4abc-8f6a-ced7db3a0804 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:14.597025 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c55ff49c-4476-4abc-8f6a-ced7db3a0804 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:14.602328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c55ff49c-4476-4abc-8f6a-ced7db3a0804 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:14.603120 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c55ff49c-4476-4abc-8f6a-ced7db3a0804 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:14.604059 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c55ff49c-4476-4abc-8f6a-ced7db3a0804 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:14.633715 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-d12c64b5-fad7-41d5-bb10-b01727f326a3 req-5a4ab729-2135-4d9d-8d40-3f6973f16882 service nova] Creating event network-vif-plugged:178adb30-0da6-4996-903a-4ee020de2a0a for instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 on hv-cinder-85604 Oct 06 12:25:14.664411 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-d12c64b5-fad7-41d5-bb10-b01727f326a3 req-5a4ab729-2135-4d9d-8d40-3f6973f16882 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105647 Oct 06 12:25:14.665689 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 194/381] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:25:14.905409 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c55ff49c-4476-4abc-8f6a-ced7db3a0804 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:14.915981 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c55ff49c-4476-4abc-8f6a-ced7db3a0804 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1314 microversion: 2.1 time: 0.390601 Oct 06 12:25:14.934618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 188/382] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:14 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:15.174393 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f36d090b-47c4-4404-860f-a80ce4843a04 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:15.175481 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f36d090b-47c4-4404-860f-a80ce4843a04 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:15.184596 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f36d090b-47c4-4404-860f-a80ce4843a04 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:15.185396 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f36d090b-47c4-4404-860f-a80ce4843a04 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:15.185982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f36d090b-47c4-4404-860f-a80ce4843a04 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:15.187410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f36d090b-47c4-4404-860f-a80ce4843a04 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:15.188079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f36d090b-47c4-4404-860f-a80ce4843a04 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:15.188969 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f36d090b-47c4-4404-860f-a80ce4843a04 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:15.220057 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=100 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:15.453824 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b775fcad-28c3-42a7-b361-5e4e9378392d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:15.455164 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b775fcad-28c3-42a7-b361-5e4e9378392d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:15.472153 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b775fcad-28c3-42a7-b361-5e4e9378392d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:15.473058 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b775fcad-28c3-42a7-b361-5e4e9378392d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:15.474231 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b775fcad-28c3-42a7-b361-5e4e9378392d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:15.477567 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b775fcad-28c3-42a7-b361-5e4e9378392d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:15.478549 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b775fcad-28c3-42a7-b361-5e4e9378392d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:15.479179 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b775fcad-28c3-42a7-b361-5e4e9378392d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:15.564355 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b775fcad-28c3-42a7-b361-5e4e9378392d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:15.564846 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b775fcad-28c3-42a7-b361-5e4e9378392d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:15.565279 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b775fcad-28c3-42a7-b361-5e4e9378392d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:15.565718 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-b775fcad-28c3-42a7-b361-5e4e9378392d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 5bf13a44-e331-4b28-9d44-6890e99df4de {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:25:15.715755 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b775fcad-28c3-42a7-b361-5e4e9378392d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:15.723914 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b775fcad-28c3-42a7-b361-5e4e9378392d tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 200 len: 1304 microversion: 2.1 time: 0.282923 Oct 06 12:25:15.724522 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 189/383] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:15 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 1304 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:15.792674 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f36d090b-47c4-4404-860f-a80ce4843a04 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:15.801928 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f36d090b-47c4-4404-860f-a80ce4843a04 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:15.803376 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f36d090b-47c4-4404-860f-a80ce4843a04 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:15.804557 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f36d090b-47c4-4404-860f-a80ce4843a04 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1405 microversion: 2.20 time: 0.635024 Oct 06 12:25:15.805120 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 195/384] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:15 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1405 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:25:15.943395 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-76b5c059-e84b-4581-8e97-ff7dab40cb68 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:15.944068 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-76b5c059-e84b-4581-8e97-ff7dab40cb68 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:15.951705 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-76b5c059-e84b-4581-8e97-ff7dab40cb68 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:15.952336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-76b5c059-e84b-4581-8e97-ff7dab40cb68 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:15.952859 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-76b5c059-e84b-4581-8e97-ff7dab40cb68 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:15.953636 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-76b5c059-e84b-4581-8e97-ff7dab40cb68 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:15.954086 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-76b5c059-e84b-4581-8e97-ff7dab40cb68 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:15.954509 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-76b5c059-e84b-4581-8e97-ff7dab40cb68 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:16.056730 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-76b5c059-e84b-4581-8e97-ff7dab40cb68 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:16.068252 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-76b5c059-e84b-4581-8e97-ff7dab40cb68 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1302 microversion: 2.1 time: 0.129832 Oct 06 12:25:16.068843 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 190/385] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:15 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1302 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:16.747599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7fb80620-bf07-4129-a326-7c49c884846c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:16.748953 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7fb80620-bf07-4129-a326-7c49c884846c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 5bf13a44-e331-4b28-9d44-6890e99df4de] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:16.765235 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7fb80620-bf07-4129-a326-7c49c884846c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:16.765840 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7fb80620-bf07-4129-a326-7c49c884846c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:16.766149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7fb80620-bf07-4129-a326-7c49c884846c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:16.766872 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7fb80620-bf07-4129-a326-7c49c884846c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:16.767333 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7fb80620-bf07-4129-a326-7c49c884846c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:16.767811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7fb80620-bf07-4129-a326-7c49c884846c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:16.793798 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-7fb80620-bf07-4129-a326-7c49c884846c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] HTTP exception thrown: Instance 5bf13a44-e331-4b28-9d44-6890e99df4de could not be found. Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7fb80620-bf07-4129-a326-7c49c884846c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Request method failure captured: Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de HTTP/1.1 Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPskD7nB67jvgIhLyVbHlTUNrp05JdKAhoXfzKFI_6vFcAc_N-M-Q_3F1aNeDtZVa2hSFzdh-mS7PEKT1ccykNbEtEawGpW-I-Jw6p9w5H_IaDi_wTF1v5yLD1ZfRKUFgWELfrW_Ib-2FldxPSn2ehrj20r0204fqFF17mRVn0IfUphE Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: 53e1ba5fc96344cebdb16d6a3e50ab8f Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-VolumesActionsTest-934281125 Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:25:16.800138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:25:16.801796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53e1ba5fc96344cebdb16d6a3e50ab8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53e1ba5fc96344cebdb16d6a3e50ab8f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53e1ba5fc96344cebdb16d6a3e50ab8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53e1ba5fc96344cebdb16d6a3e50ab8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:25:16.801796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-VolumesActionsTest-934281125 Oct 06 12:25:16.801796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: 53e1ba5fc96344cebdb16d6a3e50ab8f Oct 06 12:25:16.801796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-VolumesActionsTest-934281125 Oct 06 12:25:16.801796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-VolumesActionsTest-934281125-project Oct 06 12:25:16.801796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:25:16.801796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:25:16.801796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 8d817e129beb41168af70c3ada99aeda Oct 06 12:25:16.801796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-VolumesActionsTest-934281125-project Oct 06 12:25:16.801796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:25:16.801796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance 5bf13a44-e331-4b28-9d44-6890e99df4de could not be found. Oct 06 12:25:16.801796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '5bf13a44-e331-4b28-9d44-6890e99df4de'} Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf13a44-e331-4b28-9d44-6890e99df4de could not be found. Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:25:16.803313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf13a44-e331-4b28-9d44-6890e99df4de could not be found. Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf13a44-e331-4b28-9d44-6890e99df4de could not be found. Oct 06 12:25:16.804856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:25:16.807822 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7fb80620-bf07-4129-a326-7c49c884846c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Returning 404 to user: Instance 5bf13a44-e331-4b28-9d44-6890e99df4de could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:25:16.810216 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7fb80620-bf07-4129-a326-7c49c884846c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de" status: 404 len: 111 microversion: 2.1 time: 0.066606 Oct 06 12:25:16.811624 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 196/386] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:16 2022] GET /compute/v2.1/servers/5bf13a44-e331-4b28-9d44-6890e99df4de => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:25:16.835056 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-fdf1b67b-7918-4cbb-9050-e625954e47f5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:16.837462 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-fdf1b67b-7918-4cbb-9050-e625954e47f5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:16.852816 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fdf1b67b-7918-4cbb-9050-e625954e47f5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:16.853599 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fdf1b67b-7918-4cbb-9050-e625954e47f5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:16.854796 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fdf1b67b-7918-4cbb-9050-e625954e47f5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:16.868201 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fdf1b67b-7918-4cbb-9050-e625954e47f5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:16.871154 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fdf1b67b-7918-4cbb-9050-e625954e47f5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:16.872779 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fdf1b67b-7918-4cbb-9050-e625954e47f5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:17.000124 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1089588116", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "networks": [{"uuid": "a3b35b13-487e-4ccb-b137-7c1ff7b66ae5"}]}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:17.083966 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.network.neutron [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] validate_networks() for [('a3b35b13-487e-4ccb-b137-7c1ff7b66ae5', None, None, None, None, None)] {{(pid=120508) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:25:17.495438 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fdf1b67b-7918-4cbb-9050-e625954e47f5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:17.509942 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fdf1b67b-7918-4cbb-9050-e625954e47f5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:17.511822 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fdf1b67b-7918-4cbb-9050-e625954e47f5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:17.513031 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-fdf1b67b-7918-4cbb-9050-e625954e47f5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1405 microversion: 2.20 time: 0.687265 Oct 06 12:25:17.514184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 191/387] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:16 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1405 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:25:17.519144 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4dfc79c3-e8f3-4efb-b978-371e594ac520 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:17.520129 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4dfc79c3-e8f3-4efb-b978-371e594ac520 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:17.527519 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4dfc79c3-e8f3-4efb-b978-371e594ac520 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:17.528119 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4dfc79c3-e8f3-4efb-b978-371e594ac520 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:17.528643 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4dfc79c3-e8f3-4efb-b978-371e594ac520 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:17.533523 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4dfc79c3-e8f3-4efb-b978-371e594ac520 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:17.534277 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4dfc79c3-e8f3-4efb-b978-371e594ac520 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:17.534892 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4dfc79c3-e8f3-4efb-b978-371e594ac520 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:17.714199 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4dfc79c3-e8f3-4efb-b978-371e594ac520 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:17.722595 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4dfc79c3-e8f3-4efb-b978-371e594ac520 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1302 microversion: 2.1 time: 0.207281 Oct 06 12:25:17.723561 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 192/388] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:17 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1302 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:18.471634 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Flavor limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:25:18.472627 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Image limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:25:18.474839 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Flavor pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:25:18.476466 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Image pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:25:18.477737 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:25:18.518514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:18.520892 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:18.522258 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:18.524722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:18.526232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:18.527395 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:18.540380 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a6122333-882d-4876-b73d-4cf07edbc4e4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:18.541054 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a6122333-882d-4876-b73d-4cf07edbc4e4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:18.549865 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a6122333-882d-4876-b73d-4cf07edbc4e4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:18.552905 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a6122333-882d-4876-b73d-4cf07edbc4e4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:18.553362 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a6122333-882d-4876-b73d-4cf07edbc4e4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:18.554075 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a6122333-882d-4876-b73d-4cf07edbc4e4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:18.554534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a6122333-882d-4876-b73d-4cf07edbc4e4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:18.554957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a6122333-882d-4876-b73d-4cf07edbc4e4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:18.594640 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Getting quotas for project 53e1ba5fc96344cebdb16d6a3e50ab8f. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:25:18.600253 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Getting quotas for user 8d817e129beb41168af70c3ada99aeda and project 53e1ba5fc96344cebdb16d6a3e50ab8f. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:25:18.622827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Going to run 1 instances... {{(pid=120508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:25:18.625974 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:25:18.707990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b7578d10-df86-4425-8f93-0abf341bca47 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.713083 Oct 06 12:25:18.720344 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 197/389] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:25:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:25:18.725887 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-660600b7-eae1-4a5b-9201-74da43c88b56 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:18.726516 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-660600b7-eae1-4a5b-9201-74da43c88b56 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:18.746966 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:18.868605 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-660600b7-eae1-4a5b-9201-74da43c88b56 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:18.894018 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-660600b7-eae1-4a5b-9201-74da43c88b56 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1214 microversion: 2.1 time: 0.158268 Oct 06 12:25:18.894680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 198/390] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:18 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:18.906666 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-99c1d1bb-6046-45c3-8a97-7696980edaf8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:18.912338 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-99c1d1bb-6046-45c3-8a97-7696980edaf8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:18.946451 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-99c1d1bb-6046-45c3-8a97-7696980edaf8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:18.949386 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-99c1d1bb-6046-45c3-8a97-7696980edaf8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:18.950372 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-99c1d1bb-6046-45c3-8a97-7696980edaf8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:18.953507 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-99c1d1bb-6046-45c3-8a97-7696980edaf8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:18.954526 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-99c1d1bb-6046-45c3-8a97-7696980edaf8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:18.956637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-99c1d1bb-6046-45c3-8a97-7696980edaf8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:19.075400 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a6122333-882d-4876-b73d-4cf07edbc4e4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:19.088420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a6122333-882d-4876-b73d-4cf07edbc4e4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:19.091548 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a6122333-882d-4876-b73d-4cf07edbc4e4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:19.093056 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a6122333-882d-4876-b73d-4cf07edbc4e4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1405 microversion: 2.20 time: 0.556793 Oct 06 12:25:19.097664 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 193/391] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:18 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1405 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:25:19.243747 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-99c1d1bb-6046-45c3-8a97-7696980edaf8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:19.252571 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-99c1d1bb-6046-45c3-8a97-7696980edaf8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1370 microversion: 2.1 time: 0.354459 Oct 06 12:25:19.256565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 199/392] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:18 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1370 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:19.922614 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f3d9ed35-78a4-4905-8a54-f6fb7e399b0e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:19.923331 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f3d9ed35-78a4-4905-8a54-f6fb7e399b0e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:19.932301 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:19.933981 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:19.937370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f3d9ed35-78a4-4905-8a54-f6fb7e399b0e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:19.938056 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f3d9ed35-78a4-4905-8a54-f6fb7e399b0e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:19.940055 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f3d9ed35-78a4-4905-8a54-f6fb7e399b0e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:19.940847 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f3d9ed35-78a4-4905-8a54-f6fb7e399b0e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:19.952285 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f3d9ed35-78a4-4905-8a54-f6fb7e399b0e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:19.953016 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f3d9ed35-78a4-4905-8a54-f6fb7e399b0e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:20.115208 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f3d9ed35-78a4-4905-8a54-f6fb7e399b0e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:20.122951 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-74c58402-6333-4d5b-8b08-5971a59806fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:20.125757 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-74c58402-6333-4d5b-8b08-5971a59806fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:20.140224 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f3d9ed35-78a4-4905-8a54-f6fb7e399b0e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1218 microversion: 2.1 time: 0.222421 Oct 06 12:25:20.143257 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-74c58402-6333-4d5b-8b08-5971a59806fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:20.143783 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-74c58402-6333-4d5b-8b08-5971a59806fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:20.144221 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-74c58402-6333-4d5b-8b08-5971a59806fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:20.144925 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-74c58402-6333-4d5b-8b08-5971a59806fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:20.145915 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-74c58402-6333-4d5b-8b08-5971a59806fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:20.146367 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-74c58402-6333-4d5b-8b08-5971a59806fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:20.149220 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 194/393] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:19 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1218 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:20.280737 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-df01c3d0-773c-4b6a-bcc6-dc155864d2a1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:20.282000 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-df01c3d0-773c-4b6a-bcc6-dc155864d2a1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:20.290663 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-df01c3d0-773c-4b6a-bcc6-dc155864d2a1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:20.293099 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-df01c3d0-773c-4b6a-bcc6-dc155864d2a1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:20.293739 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-df01c3d0-773c-4b6a-bcc6-dc155864d2a1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:20.295170 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-df01c3d0-773c-4b6a-bcc6-dc155864d2a1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:20.298216 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-df01c3d0-773c-4b6a-bcc6-dc155864d2a1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:20.298838 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-df01c3d0-773c-4b6a-bcc6-dc155864d2a1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:20.775862 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-74c58402-6333-4d5b-8b08-5971a59806fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:20.790181 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-74c58402-6333-4d5b-8b08-5971a59806fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:20.795197 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-74c58402-6333-4d5b-8b08-5971a59806fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:20.800057 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-74c58402-6333-4d5b-8b08-5971a59806fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1405 microversion: 2.20 time: 0.678825 Oct 06 12:25:20.803301 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 200/394] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:20 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1405 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:25:20.837233 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-df01c3d0-773c-4b6a-bcc6-dc155864d2a1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:20.849101 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-df01c3d0-773c-4b6a-bcc6-dc155864d2a1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1370 microversion: 2.1 time: 0.573551 Oct 06 12:25:20.852471 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 195/395] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:20 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1370 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:21.167699 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5c8a3cc1-917c-4482-b58a-af4159e001a7 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:21.169371 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5c8a3cc1-917c-4482-b58a-af4159e001a7 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:21.182044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c8a3cc1-917c-4482-b58a-af4159e001a7 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:21.183178 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c8a3cc1-917c-4482-b58a-af4159e001a7 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:21.183918 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c8a3cc1-917c-4482-b58a-af4159e001a7 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:21.184938 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c8a3cc1-917c-4482-b58a-af4159e001a7 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:21.185677 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c8a3cc1-917c-4482-b58a-af4159e001a7 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:21.186385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c8a3cc1-917c-4482-b58a-af4159e001a7 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:21.312444 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5c8a3cc1-917c-4482-b58a-af4159e001a7 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:21.328393 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5c8a3cc1-917c-4482-b58a-af4159e001a7 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1218 microversion: 2.1 time: 0.166019 Oct 06 12:25:21.328993 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 201/396] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:21 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1218 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:21.825878 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-413e77bb-4e62-42be-aff7-e51854028d75 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:21.826501 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-413e77bb-4e62-42be-aff7-e51854028d75 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:21.837353 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-413e77bb-4e62-42be-aff7-e51854028d75 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:21.837857 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-413e77bb-4e62-42be-aff7-e51854028d75 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:21.838294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-413e77bb-4e62-42be-aff7-e51854028d75 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:21.839005 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-413e77bb-4e62-42be-aff7-e51854028d75 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:21.839461 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-413e77bb-4e62-42be-aff7-e51854028d75 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:21.839928 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-413e77bb-4e62-42be-aff7-e51854028d75 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:21.876263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-231c102c-cfb6-4fa6-88c6-c493640a8b77 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:21.876956 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-231c102c-cfb6-4fa6-88c6-c493640a8b77 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:21.891005 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-231c102c-cfb6-4fa6-88c6-c493640a8b77 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:21.891546 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-231c102c-cfb6-4fa6-88c6-c493640a8b77 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:21.891982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-231c102c-cfb6-4fa6-88c6-c493640a8b77 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:21.892702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-231c102c-cfb6-4fa6-88c6-c493640a8b77 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:21.893160 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-231c102c-cfb6-4fa6-88c6-c493640a8b77 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:21.905041 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-231c102c-cfb6-4fa6-88c6-c493640a8b77 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:22.725821 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-231c102c-cfb6-4fa6-88c6-c493640a8b77 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:22.752800 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-231c102c-cfb6-4fa6-88c6-c493640a8b77 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1370 microversion: 2.1 time: 0.880145 Oct 06 12:25:22.753970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 202/397] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:21 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1370 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:22.793061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5a1da8c0-e5a4-40d3-8f60-4d8816acdb3b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:22.793308 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5a1da8c0-e5a4-40d3-8f60-4d8816acdb3b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:22.805770 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5a1da8c0-e5a4-40d3-8f60-4d8816acdb3b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:22.806745 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5a1da8c0-e5a4-40d3-8f60-4d8816acdb3b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:22.808318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5a1da8c0-e5a4-40d3-8f60-4d8816acdb3b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:22.809283 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5a1da8c0-e5a4-40d3-8f60-4d8816acdb3b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:22.809963 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5a1da8c0-e5a4-40d3-8f60-4d8816acdb3b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:22.810660 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5a1da8c0-e5a4-40d3-8f60-4d8816acdb3b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:23.217296 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-413e77bb-4e62-42be-aff7-e51854028d75 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:23.234233 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-413e77bb-4e62-42be-aff7-e51854028d75 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:23.239063 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-413e77bb-4e62-42be-aff7-e51854028d75 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:23.241727 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-413e77bb-4e62-42be-aff7-e51854028d75 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1596 microversion: 2.20 time: 1.420235 Oct 06 12:25:23.246460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5a1da8c0-e5a4-40d3-8f60-4d8816acdb3b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:23.247664 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 196/398] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:25:21 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1596 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:25:23.259718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5a1da8c0-e5a4-40d3-8f60-4d8816acdb3b tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1274 microversion: 2.1 time: 0.477021 Oct 06 12:25:23.260674 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 203/399] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:22 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1274 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:23.283758 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-23adb5b2-298e-4d34-8310-ac0a959c73ec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:23.286710 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-23adb5b2-298e-4d34-8310-ac0a959c73ec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:23.295291 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23adb5b2-298e-4d34-8310-ac0a959c73ec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:23.296136 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23adb5b2-298e-4d34-8310-ac0a959c73ec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:23.296802 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23adb5b2-298e-4d34-8310-ac0a959c73ec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:23.298797 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23adb5b2-298e-4d34-8310-ac0a959c73ec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:23.299338 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23adb5b2-298e-4d34-8310-ac0a959c73ec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:23.300099 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23adb5b2-298e-4d34-8310-ac0a959c73ec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:23.650791 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-23adb5b2-298e-4d34-8310-ac0a959c73ec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.381365 Oct 06 12:25:23.651601 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 197/400] 10.222.0.33 () {60 vars in 1316 bytes} [Thu Oct 6 12:25:23 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-interface => generated 284 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:25:23.781369 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-64c8d93b-9f3e-4868-8bad-2499ec58cf6c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:23.794782 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-64c8d93b-9f3e-4868-8bad-2499ec58cf6c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:23.812210 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-64c8d93b-9f3e-4868-8bad-2499ec58cf6c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:23.812713 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-64c8d93b-9f3e-4868-8bad-2499ec58cf6c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:23.813160 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-64c8d93b-9f3e-4868-8bad-2499ec58cf6c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:23.813873 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-64c8d93b-9f3e-4868-8bad-2499ec58cf6c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:23.814778 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-64c8d93b-9f3e-4868-8bad-2499ec58cf6c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:23.815217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-64c8d93b-9f3e-4868-8bad-2499ec58cf6c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:24.286895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-47e07499-cfe2-4349-ae6f-f1690aadcf42 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:24.288086 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-47e07499-cfe2-4349-ae6f-f1690aadcf42 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:24.298425 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-47e07499-cfe2-4349-ae6f-f1690aadcf42 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:24.300515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-47e07499-cfe2-4349-ae6f-f1690aadcf42 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:24.301158 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-47e07499-cfe2-4349-ae6f-f1690aadcf42 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:24.303518 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-47e07499-cfe2-4349-ae6f-f1690aadcf42 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:24.304153 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-47e07499-cfe2-4349-ae6f-f1690aadcf42 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:24.313242 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-47e07499-cfe2-4349-ae6f-f1690aadcf42 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:24.338441 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-64c8d93b-9f3e-4868-8bad-2499ec58cf6c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:24.363269 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-64c8d93b-9f3e-4868-8bad-2499ec58cf6c tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1370 microversion: 2.1 time: 0.585972 Oct 06 12:25:24.366802 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 204/401] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:23 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1370 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:24.464233 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-47e07499-cfe2-4349-ae6f-f1690aadcf42 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:24.479680 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-47e07499-cfe2-4349-ae6f-f1690aadcf42 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1272 microversion: 2.1 time: 0.196750 Oct 06 12:25:24.480291 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 198/402] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:24 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:25.012837 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-c0a9010e-6f75-4afb-b2ed-49dfd73e5e54 req-8129b53d-8479-48ab-afcb-9a0bda52bd45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1620fb3a-f872-41f2-83d2-909fbe71f438", "tag": "02cb1ceb-4a00-4f6e-8fe3-e8409283f314"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:25.032195 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-c0a9010e-6f75-4afb-b2ed-49dfd73e5e54 req-8129b53d-8479-48ab-afcb-9a0bda52bd45 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:25.032987 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-c0a9010e-6f75-4afb-b2ed-49dfd73e5e54 req-8129b53d-8479-48ab-afcb-9a0bda52bd45 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:25.033615 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-c0a9010e-6f75-4afb-b2ed-49dfd73e5e54 req-8129b53d-8479-48ab-afcb-9a0bda52bd45 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:25.066650 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-c0a9010e-6f75-4afb-b2ed-49dfd73e5e54 req-8129b53d-8479-48ab-afcb-9a0bda52bd45 service nova] Creating event network-changed:02cb1ceb-4a00-4f6e-8fe3-e8409283f314 for instance 1620fb3a-f872-41f2-83d2-909fbe71f438 on hv-cinder-85604 Oct 06 12:25:25.075721 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-c0a9010e-6f75-4afb-b2ed-49dfd73e5e54 req-8129b53d-8479-48ab-afcb-9a0bda52bd45 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080134 Oct 06 12:25:25.077665 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 205/403] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:25:25.397204 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-cad8779b-f08a-4461-be72-d4df73c8e0ba tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:25.406894 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-cad8779b-f08a-4461-be72-d4df73c8e0ba tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:25.426688 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cad8779b-f08a-4461-be72-d4df73c8e0ba tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:25.427907 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cad8779b-f08a-4461-be72-d4df73c8e0ba tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:25.428401 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cad8779b-f08a-4461-be72-d4df73c8e0ba tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:25.429461 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cad8779b-f08a-4461-be72-d4df73c8e0ba tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:25.436095 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cad8779b-f08a-4461-be72-d4df73c8e0ba tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:25.436626 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cad8779b-f08a-4461-be72-d4df73c8e0ba tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:25.516399 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-10e854d1-a5dc-4362-878d-748520f300df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:25.517586 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-10e854d1-a5dc-4362-878d-748520f300df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:25.530756 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-10e854d1-a5dc-4362-878d-748520f300df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:25.534152 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-10e854d1-a5dc-4362-878d-748520f300df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:25.534883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-10e854d1-a5dc-4362-878d-748520f300df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:25.538171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-10e854d1-a5dc-4362-878d-748520f300df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:25.540021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-10e854d1-a5dc-4362-878d-748520f300df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:25.540777 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-10e854d1-a5dc-4362-878d-748520f300df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:25.863063 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-cad8779b-f08a-4461-be72-d4df73c8e0ba tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:25.887057 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-cad8779b-f08a-4461-be72-d4df73c8e0ba tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1370 microversion: 2.1 time: 0.499916 Oct 06 12:25:25.900959 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 199/404] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:25 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1370 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:26.038619 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-10e854d1-a5dc-4362-878d-748520f300df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:26.056822 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-10e854d1-a5dc-4362-878d-748520f300df tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1314 microversion: 2.1 time: 0.553427 Oct 06 12:25:26.071679 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 206/405] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:25 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:26.914074 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7e1797ca-1222-4c0c-b56e-cf6b73eac661 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:26.914686 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7e1797ca-1222-4c0c-b56e-cf6b73eac661 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:26.926063 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7e1797ca-1222-4c0c-b56e-cf6b73eac661 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:26.927159 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7e1797ca-1222-4c0c-b56e-cf6b73eac661 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:26.928721 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7e1797ca-1222-4c0c-b56e-cf6b73eac661 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:26.929616 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7e1797ca-1222-4c0c-b56e-cf6b73eac661 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:26.932107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7e1797ca-1222-4c0c-b56e-cf6b73eac661 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:26.934422 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7e1797ca-1222-4c0c-b56e-cf6b73eac661 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:27.081301 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8e83e884-d52f-4562-8a75-df692379ebd8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:27.082225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8e83e884-d52f-4562-8a75-df692379ebd8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:27.097945 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e83e884-d52f-4562-8a75-df692379ebd8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:27.098818 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e83e884-d52f-4562-8a75-df692379ebd8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:27.101238 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e83e884-d52f-4562-8a75-df692379ebd8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:27.102255 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e83e884-d52f-4562-8a75-df692379ebd8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:27.104270 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e83e884-d52f-4562-8a75-df692379ebd8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:27.106956 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e83e884-d52f-4562-8a75-df692379ebd8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:27.410436 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7e1797ca-1222-4c0c-b56e-cf6b73eac661 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:27.414928 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=100 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:27.425277 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7e1797ca-1222-4c0c-b56e-cf6b73eac661 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1370 microversion: 2.1 time: 0.513165 Oct 06 12:25:27.426718 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 200/406] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:26 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1370 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:27.436532 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-fceccd38-f1b6-498c-87c0-7e9fdcd1dc57 req-96ffe494-9238-4c09-aa60-3cb3c0f36946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b1825b8-e10c-4c5b-adf9-3456c97a68e2", "tag": "178adb30-0da6-4996-903a-4ee020de2a0a"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:27.464905 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-fceccd38-f1b6-498c-87c0-7e9fdcd1dc57 req-96ffe494-9238-4c09-aa60-3cb3c0f36946 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:27.465626 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-fceccd38-f1b6-498c-87c0-7e9fdcd1dc57 req-96ffe494-9238-4c09-aa60-3cb3c0f36946 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:27.471322 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-fceccd38-f1b6-498c-87c0-7e9fdcd1dc57 req-96ffe494-9238-4c09-aa60-3cb3c0f36946 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:27.514639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-fceccd38-f1b6-498c-87c0-7e9fdcd1dc57 req-96ffe494-9238-4c09-aa60-3cb3c0f36946 service nova] Creating event network-changed:178adb30-0da6-4996-903a-4ee020de2a0a for instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 on hv-cinder-85604 Oct 06 12:25:27.536378 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-fceccd38-f1b6-498c-87c0-7e9fdcd1dc57 req-96ffe494-9238-4c09-aa60-3cb3c0f36946 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100653 Oct 06 12:25:27.537144 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 201/407] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:25:27.681643 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8e83e884-d52f-4562-8a75-df692379ebd8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:27.695989 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8e83e884-d52f-4562-8a75-df692379ebd8 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1314 microversion: 2.1 time: 0.618206 Oct 06 12:25:27.708267 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 207/408] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:27 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:27.862619 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-8fc10ed0-bd6a-4314-b97e-f4cd3b34b90f req-f95e2422-7d5a-45ac-a1ed-395ae8e1baeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8e72d3-918b-4046-897d-e7c3f5a5913c", "tag": "5fc05d61-8835-4816-b8ac-5f557c8e0fdb"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:27.883644 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-8fc10ed0-bd6a-4314-b97e-f4cd3b34b90f req-f95e2422-7d5a-45ac-a1ed-395ae8e1baeb service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:27.886269 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-8fc10ed0-bd6a-4314-b97e-f4cd3b34b90f req-f95e2422-7d5a-45ac-a1ed-395ae8e1baeb service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:27.886861 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-8fc10ed0-bd6a-4314-b97e-f4cd3b34b90f req-f95e2422-7d5a-45ac-a1ed-395ae8e1baeb service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:27.911067 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-8fc10ed0-bd6a-4314-b97e-f4cd3b34b90f req-f95e2422-7d5a-45ac-a1ed-395ae8e1baeb service nova] Creating event network-changed:5fc05d61-8835-4816-b8ac-5f557c8e0fdb for instance 0d8e72d3-918b-4046-897d-e7c3f5a5913c on hv-cinder-85604 Oct 06 12:25:27.917602 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-8fc10ed0-bd6a-4314-b97e-f4cd3b34b90f req-f95e2422-7d5a-45ac-a1ed-395ae8e1baeb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059080 Oct 06 12:25:27.921921 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 208/409] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:25:28.376575 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-6a2126a8-ea9c-4833-b859-5125398e9d5b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Action: 'create', calling method: .version_select at 0x7f03aaceef70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-679794386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAN8Pnq14N9ddw3pCE2WD7o/1wc0KtarZ7E5+s0/Lfk/V0OyXuDPsOWg7SpxazBrj/2CCbpdw0ObcMJXBXxxWtWK80Pbkx03xVAmeEIganVF71PX/LmOSpDSAtKgYZ9bqA=="}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:28.417065 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-6a2126a8-ea9c-4833-b859-5125398e9d5b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Getting quotas for project c80feb95ecbf413ca0bc52a519bf43b7. Resources: {'key_pairs'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:25:28.425835 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-6a2126a8-ea9c-4833-b859-5125398e9d5b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Getting quotas for user dff0daad12c143fabd16d40a1939b87e and project c80feb95ecbf413ca0bc52a519bf43b7. Resources: {'key_pairs'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:25:28.450765 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7f4b65ea-f045-419d-a64a-2ffa1a415b81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:28.451225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7f4b65ea-f045-419d-a64a-2ffa1a415b81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:28.467915 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f4b65ea-f045-419d-a64a-2ffa1a415b81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:28.472150 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f4b65ea-f045-419d-a64a-2ffa1a415b81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:28.472600 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f4b65ea-f045-419d-a64a-2ffa1a415b81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:28.474675 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f4b65ea-f045-419d-a64a-2ffa1a415b81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:28.481304 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f4b65ea-f045-419d-a64a-2ffa1a415b81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:28.482409 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f4b65ea-f045-419d-a64a-2ffa1a415b81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:28.484142 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-6a2126a8-ea9c-4833-b859-5125398e9d5b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.632531 Oct 06 12:25:28.489410 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 202/410] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 12:25:27 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:25:28.563242 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=4 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:28.726168 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ea86b571-8db8-4f06-a618-6fca8fa6f1d6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:28.727651 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ea86b571-8db8-4f06-a618-6fca8fa6f1d6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:28.739555 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ea86b571-8db8-4f06-a618-6fca8fa6f1d6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:28.740573 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ea86b571-8db8-4f06-a618-6fca8fa6f1d6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:28.742370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ea86b571-8db8-4f06-a618-6fca8fa6f1d6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:28.743262 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ea86b571-8db8-4f06-a618-6fca8fa6f1d6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:28.744620 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ea86b571-8db8-4f06-a618-6fca8fa6f1d6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:28.745802 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ea86b571-8db8-4f06-a618-6fca8fa6f1d6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:28.876052 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=18 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:29.002973 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7f4b65ea-f045-419d-a64a-2ffa1a415b81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:29.023238 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7f4b65ea-f045-419d-a64a-2ffa1a415b81 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1370 microversion: 2.1 time: 0.576756 Oct 06 12:25:29.025565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 209/411] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:28 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1370 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:29.158064 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ea86b571-8db8-4f06-a618-6fca8fa6f1d6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:29.167012 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ea86b571-8db8-4f06-a618-6fca8fa6f1d6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1314 microversion: 2.1 time: 0.444867 Oct 06 12:25:29.170744 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 203/412] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:28 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:30.051183 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-52a2574b-51ba-4d56-8ec4-5c1c34cbb9e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:30.054857 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-52a2574b-51ba-4d56-8ec4-5c1c34cbb9e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:30.069597 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-52a2574b-51ba-4d56-8ec4-5c1c34cbb9e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:30.071192 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-52a2574b-51ba-4d56-8ec4-5c1c34cbb9e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:30.072157 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-52a2574b-51ba-4d56-8ec4-5c1c34cbb9e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:30.074661 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-52a2574b-51ba-4d56-8ec4-5c1c34cbb9e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:30.075471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-52a2574b-51ba-4d56-8ec4-5c1c34cbb9e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:30.076248 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-52a2574b-51ba-4d56-8ec4-5c1c34cbb9e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:30.198357 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3230a7e5-465a-48a6-8e8b-e2a6a4d0fd89 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:30.198967 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3230a7e5-465a-48a6-8e8b-e2a6a4d0fd89 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:30.215164 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3230a7e5-465a-48a6-8e8b-e2a6a4d0fd89 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:30.215613 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3230a7e5-465a-48a6-8e8b-e2a6a4d0fd89 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:30.216285 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3230a7e5-465a-48a6-8e8b-e2a6a4d0fd89 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:30.217194 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3230a7e5-465a-48a6-8e8b-e2a6a4d0fd89 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:30.217832 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3230a7e5-465a-48a6-8e8b-e2a6a4d0fd89 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:30.218441 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3230a7e5-465a-48a6-8e8b-e2a6a4d0fd89 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:31.044284 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-52a2574b-51ba-4d56-8ec4-5c1c34cbb9e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:31.060829 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-52a2574b-51ba-4d56-8ec4-5c1c34cbb9e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1370 microversion: 2.1 time: 1.015051 Oct 06 12:25:31.062801 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 210/413] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:30 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1370 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:31.263645 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3230a7e5-465a-48a6-8e8b-e2a6a4d0fd89 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:31.279959 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3230a7e5-465a-48a6-8e8b-e2a6a4d0fd89 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1314 microversion: 2.1 time: 1.085387 Oct 06 12:25:31.285590 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 204/414] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:30 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1314 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:32.086706 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d025caf8-c652-42e5-82db-fd3e3563d538 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:32.087324 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d025caf8-c652-42e5-82db-fd3e3563d538 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:32.112049 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d025caf8-c652-42e5-82db-fd3e3563d538 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:32.115345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d025caf8-c652-42e5-82db-fd3e3563d538 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:32.115843 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d025caf8-c652-42e5-82db-fd3e3563d538 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:32.117013 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d025caf8-c652-42e5-82db-fd3e3563d538 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:32.118924 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d025caf8-c652-42e5-82db-fd3e3563d538 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:32.119389 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d025caf8-c652-42e5-82db-fd3e3563d538 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:32.306531 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b7b56a5c-652f-43bd-9616-4267c54b3881 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:32.307233 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b7b56a5c-652f-43bd-9616-4267c54b3881 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:32.319044 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b7b56a5c-652f-43bd-9616-4267c54b3881 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:32.319897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b7b56a5c-652f-43bd-9616-4267c54b3881 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:32.320327 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b7b56a5c-652f-43bd-9616-4267c54b3881 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:32.324386 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b7b56a5c-652f-43bd-9616-4267c54b3881 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:32.325150 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b7b56a5c-652f-43bd-9616-4267c54b3881 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:32.328112 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b7b56a5c-652f-43bd-9616-4267c54b3881 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:32.860164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d025caf8-c652-42e5-82db-fd3e3563d538 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:32.875281 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d025caf8-c652-42e5-82db-fd3e3563d538 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1370 microversion: 2.1 time: 0.793111 Oct 06 12:25:32.882165 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 211/415] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:32 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1370 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:32.947573 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b7b56a5c-652f-43bd-9616-4267c54b3881 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:32.960183 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b7b56a5c-652f-43bd-9616-4267c54b3881 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1314 microversion: 2.1 time: 0.657807 Oct 06 12:25:32.966846 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 205/416] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:32 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:33.375430 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-693642857", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "networks": [{"uuid": "11dfbbc8-d8d2-470b-88d8-288b0ef74b7b"}]}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:33.438470 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.network.neutron [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] validate_networks() for [('11dfbbc8-d8d2-470b-88d8-288b0ef74b7b', None, None, None, None, None)] {{(pid=120508) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:25:33.913624 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-790f0d67-bf9d-4873-856f-b906412bb4d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:33.915035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-790f0d67-bf9d-4873-856f-b906412bb4d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:33.926098 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-790f0d67-bf9d-4873-856f-b906412bb4d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:33.927099 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-790f0d67-bf9d-4873-856f-b906412bb4d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:33.929290 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-790f0d67-bf9d-4873-856f-b906412bb4d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:33.930735 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-790f0d67-bf9d-4873-856f-b906412bb4d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:33.931959 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-790f0d67-bf9d-4873-856f-b906412bb4d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:33.932883 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-790f0d67-bf9d-4873-856f-b906412bb4d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:33.935138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Flavor limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:25:33.935636 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Image limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:25:33.936306 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Flavor pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:25:33.936789 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Image pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:25:33.937149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:25:33.951801 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:33.952567 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:33.953205 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:33.954980 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:33.955673 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:33.958063 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:33.983916 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Getting quotas for project d2d5034a312544cd9a1d72439556cf41. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:25:33.993508 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Getting quotas for user 7e650801308e4a79b259e239831491e3 and project d2d5034a312544cd9a1d72439556cf41. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:25:34.007950 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Going to run 1 instances... {{(pid=120508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:25:34.011019 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:25:34.075947 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-6f41981a-9c25-4fa7-9ff9-673f13bd5379 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704425 Oct 06 12:25:34.087896 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 212/417] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:25:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:25:34.094619 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ed494aac-27e6-45af-a455-6466e86de95e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:34.095409 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ed494aac-27e6-45af-a455-6466e86de95e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:34.102923 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed494aac-27e6-45af-a455-6466e86de95e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:34.103895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed494aac-27e6-45af-a455-6466e86de95e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:34.104488 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed494aac-27e6-45af-a455-6466e86de95e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:34.114147 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed494aac-27e6-45af-a455-6466e86de95e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:34.115261 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed494aac-27e6-45af-a455-6466e86de95e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:34.119957 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed494aac-27e6-45af-a455-6466e86de95e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:34.167036 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-790f0d67-bf9d-4873-856f-b906412bb4d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:34.177237 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-790f0d67-bf9d-4873-856f-b906412bb4d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1370 microversion: 2.1 time: 0.277132 Oct 06 12:25:34.178401 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 206/418] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:33 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1370 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:34.184128 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-88d5c6b8-a659-4d2a-aaa5-5af65896fe8e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:34.184914 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-88d5c6b8-a659-4d2a-aaa5-5af65896fe8e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:34.312573 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-88d5c6b8-a659-4d2a-aaa5-5af65896fe8e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:34.319773 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-88d5c6b8-a659-4d2a-aaa5-5af65896fe8e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1218 microversion: 2.1 time: 0.140173 Oct 06 12:25:34.324889 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 207/419] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:34 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:34.425186 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ed494aac-27e6-45af-a455-6466e86de95e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:34.437059 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ed494aac-27e6-45af-a455-6466e86de95e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1314 microversion: 2.1 time: 0.347509 Oct 06 12:25:34.438087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 213/420] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:34 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:35.204393 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e8f91931-65f2-429f-86ee-b32d3d874f8f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:35.205225 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e8f91931-65f2-429f-86ee-b32d3d874f8f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:35.219057 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e8f91931-65f2-429f-86ee-b32d3d874f8f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:35.219940 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e8f91931-65f2-429f-86ee-b32d3d874f8f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:35.220636 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e8f91931-65f2-429f-86ee-b32d3d874f8f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:35.221568 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e8f91931-65f2-429f-86ee-b32d3d874f8f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:35.222236 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e8f91931-65f2-429f-86ee-b32d3d874f8f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:35.222929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e8f91931-65f2-429f-86ee-b32d3d874f8f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:35.351144 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ee51a1f0-3263-4be1-a200-5659b771b474 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:35.353141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ee51a1f0-3263-4be1-a200-5659b771b474 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:35.364474 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee51a1f0-3263-4be1-a200-5659b771b474 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:35.365041 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee51a1f0-3263-4be1-a200-5659b771b474 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:35.367595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee51a1f0-3263-4be1-a200-5659b771b474 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:35.368672 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee51a1f0-3263-4be1-a200-5659b771b474 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:35.369463 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee51a1f0-3263-4be1-a200-5659b771b474 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:35.370285 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee51a1f0-3263-4be1-a200-5659b771b474 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:35.462127 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e8f91931-65f2-429f-86ee-b32d3d874f8f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:35.470916 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e8f91931-65f2-429f-86ee-b32d3d874f8f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1370 microversion: 2.1 time: 0.270386 Oct 06 12:25:35.475100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ee51a1f0-3263-4be1-a200-5659b771b474 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:35.486649 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ee51a1f0-3263-4be1-a200-5659b771b474 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1214 microversion: 2.1 time: 0.145967 Oct 06 12:25:35.488632 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 214/421] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:35 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:35.503445 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9e15f953-896f-46c7-a408-2eab79e85cc6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:35.506564 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 208/422] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:35 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:35.507370 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9e15f953-896f-46c7-a408-2eab79e85cc6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:35.515409 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9e15f953-896f-46c7-a408-2eab79e85cc6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:35.516197 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9e15f953-896f-46c7-a408-2eab79e85cc6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:35.522358 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9e15f953-896f-46c7-a408-2eab79e85cc6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:35.523929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9e15f953-896f-46c7-a408-2eab79e85cc6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:35.524653 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9e15f953-896f-46c7-a408-2eab79e85cc6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:35.525313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9e15f953-896f-46c7-a408-2eab79e85cc6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:35.760923 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9e15f953-896f-46c7-a408-2eab79e85cc6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:35.770739 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9e15f953-896f-46c7-a408-2eab79e85cc6 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1314 microversion: 2.1 time: 0.279969 Oct 06 12:25:35.771906 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 215/423] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:35 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:36.499386 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b363ba4f-9555-427e-bb0d-1f949e2e09d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:36.502188 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b363ba4f-9555-427e-bb0d-1f949e2e09d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:36.513700 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ae1357bc-45a8-42c4-bb3c-1f446ae71a22 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:36.516163 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ae1357bc-45a8-42c4-bb3c-1f446ae71a22 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:36.519151 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b363ba4f-9555-427e-bb0d-1f949e2e09d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:36.520828 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b363ba4f-9555-427e-bb0d-1f949e2e09d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:36.521688 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b363ba4f-9555-427e-bb0d-1f949e2e09d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:36.522942 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b363ba4f-9555-427e-bb0d-1f949e2e09d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:36.523056 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae1357bc-45a8-42c4-bb3c-1f446ae71a22 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:36.523519 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae1357bc-45a8-42c4-bb3c-1f446ae71a22 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:36.523970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae1357bc-45a8-42c4-bb3c-1f446ae71a22 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:36.524182 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b363ba4f-9555-427e-bb0d-1f949e2e09d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:36.524971 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b363ba4f-9555-427e-bb0d-1f949e2e09d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:36.539637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae1357bc-45a8-42c4-bb3c-1f446ae71a22 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:36.540253 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae1357bc-45a8-42c4-bb3c-1f446ae71a22 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:36.540747 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae1357bc-45a8-42c4-bb3c-1f446ae71a22 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:36.597687 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=100 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:36.796321 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ae1357bc-45a8-42c4-bb3c-1f446ae71a22 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:36.808741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ae1357bc-45a8-42c4-bb3c-1f446ae71a22 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1288 microversion: 2.1 time: 0.298810 Oct 06 12:25:36.813641 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 216/424] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:36 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1288 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:36.839122 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-cf630990-0748-476d-b055-06ef0f1319f2 req-d14ed215-b478-4e1d-a48d-32fadcb50605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1620fb3a-f872-41f2-83d2-909fbe71f438", "name": "network-vif-plugged", "status": "completed", "tag": "02cb1ceb-4a00-4f6e-8fe3-e8409283f314"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:36.862604 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-cf630990-0748-476d-b055-06ef0f1319f2 req-d14ed215-b478-4e1d-a48d-32fadcb50605 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:36.866223 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-cf630990-0748-476d-b055-06ef0f1319f2 req-d14ed215-b478-4e1d-a48d-32fadcb50605 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:36.866643 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b363ba4f-9555-427e-bb0d-1f949e2e09d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:36.867142 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-cf630990-0748-476d-b055-06ef0f1319f2 req-d14ed215-b478-4e1d-a48d-32fadcb50605 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:36.877370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b363ba4f-9555-427e-bb0d-1f949e2e09d0 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1370 microversion: 2.1 time: 0.384304 Oct 06 12:25:36.882449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 209/425] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:36 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1370 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:36.893189 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ad7568af-f3e2-4d73-9f16-da8c3ec55d08 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:36.894072 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ad7568af-f3e2-4d73-9f16-da8c3ec55d08 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:36.898734 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-cf630990-0748-476d-b055-06ef0f1319f2 req-d14ed215-b478-4e1d-a48d-32fadcb50605 service nova] Creating event network-vif-plugged:02cb1ceb-4a00-4f6e-8fe3-e8409283f314 for instance 1620fb3a-f872-41f2-83d2-909fbe71f438 on hv-cinder-85604 Oct 06 12:25:36.913260 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-cf630990-0748-476d-b055-06ef0f1319f2 req-d14ed215-b478-4e1d-a48d-32fadcb50605 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097976 Oct 06 12:25:36.913966 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ad7568af-f3e2-4d73-9f16-da8c3ec55d08 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:36.914472 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ad7568af-f3e2-4d73-9f16-da8c3ec55d08 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:36.915002 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ad7568af-f3e2-4d73-9f16-da8c3ec55d08 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:36.915638 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ad7568af-f3e2-4d73-9f16-da8c3ec55d08 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:36.915921 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 217/426] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:25:36.924736 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ad7568af-f3e2-4d73-9f16-da8c3ec55d08 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:36.926321 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ad7568af-f3e2-4d73-9f16-da8c3ec55d08 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:37.520197 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ad7568af-f3e2-4d73-9f16-da8c3ec55d08 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:37.533377 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ad7568af-f3e2-4d73-9f16-da8c3ec55d08 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1314 microversion: 2.1 time: 0.649563 Oct 06 12:25:37.537961 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 210/427] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:36 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:37.837761 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-051de55d-111d-4a9e-b40b-d7eea8972c8b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:37.839438 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-051de55d-111d-4a9e-b40b-d7eea8972c8b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:37.846937 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-051de55d-111d-4a9e-b40b-d7eea8972c8b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:37.850804 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-051de55d-111d-4a9e-b40b-d7eea8972c8b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:37.851606 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-051de55d-111d-4a9e-b40b-d7eea8972c8b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:37.852642 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-051de55d-111d-4a9e-b40b-d7eea8972c8b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:37.853319 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-051de55d-111d-4a9e-b40b-d7eea8972c8b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:37.853984 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-051de55d-111d-4a9e-b40b-d7eea8972c8b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:37.919553 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-1eb5fbbe-50e4-4029-a79a-c9259c61ea91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:37.920494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-1eb5fbbe-50e4-4029-a79a-c9259c61ea91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:37.928743 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1eb5fbbe-50e4-4029-a79a-c9259c61ea91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:37.929503 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1eb5fbbe-50e4-4029-a79a-c9259c61ea91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:37.930184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1eb5fbbe-50e4-4029-a79a-c9259c61ea91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:37.931177 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1eb5fbbe-50e4-4029-a79a-c9259c61ea91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:37.931876 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1eb5fbbe-50e4-4029-a79a-c9259c61ea91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:37.933065 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1eb5fbbe-50e4-4029-a79a-c9259c61ea91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:38.149831 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-051de55d-111d-4a9e-b40b-d7eea8972c8b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:38.161378 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-051de55d-111d-4a9e-b40b-d7eea8972c8b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.328748 Oct 06 12:25:38.168982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 218/428] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:37 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:38.187137 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-1eb5fbbe-50e4-4029-a79a-c9259c61ea91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:38.200279 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-1eb5fbbe-50e4-4029-a79a-c9259c61ea91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1370 microversion: 2.1 time: 0.294294 Oct 06 12:25:38.200892 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 211/429] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:37 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1370 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:38.573510 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8f85c032-995b-49ac-a366-ba9f91616f2c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:38.574662 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8f85c032-995b-49ac-a366-ba9f91616f2c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:38.582775 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8f85c032-995b-49ac-a366-ba9f91616f2c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:38.583648 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8f85c032-995b-49ac-a366-ba9f91616f2c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:38.584470 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8f85c032-995b-49ac-a366-ba9f91616f2c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:38.585418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8f85c032-995b-49ac-a366-ba9f91616f2c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:38.586875 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8f85c032-995b-49ac-a366-ba9f91616f2c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:38.587486 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8f85c032-995b-49ac-a366-ba9f91616f2c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:38.759494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8f85c032-995b-49ac-a366-ba9f91616f2c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:38.775120 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8f85c032-995b-49ac-a366-ba9f91616f2c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1314 microversion: 2.1 time: 0.216330 Oct 06 12:25:38.776623 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 219/430] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:38 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:39.184329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-69571860-9135-4af0-a6d9-cb68a9021c2c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:39.184962 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-69571860-9135-4af0-a6d9-cb68a9021c2c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:39.204267 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69571860-9135-4af0-a6d9-cb68a9021c2c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:39.204681 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69571860-9135-4af0-a6d9-cb68a9021c2c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:39.210389 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69571860-9135-4af0-a6d9-cb68a9021c2c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:39.211373 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69571860-9135-4af0-a6d9-cb68a9021c2c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:39.212011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69571860-9135-4af0-a6d9-cb68a9021c2c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:39.212588 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69571860-9135-4af0-a6d9-cb68a9021c2c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:39.225711 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-954bb1dd-76ce-4bc0-b075-0b0f35529c2e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:39.226701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-954bb1dd-76ce-4bc0-b075-0b0f35529c2e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:39.240432 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-954bb1dd-76ce-4bc0-b075-0b0f35529c2e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:39.243218 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-954bb1dd-76ce-4bc0-b075-0b0f35529c2e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:39.243734 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-954bb1dd-76ce-4bc0-b075-0b0f35529c2e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:39.250455 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-954bb1dd-76ce-4bc0-b075-0b0f35529c2e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:39.251163 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-954bb1dd-76ce-4bc0-b075-0b0f35529c2e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:39.251849 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-954bb1dd-76ce-4bc0-b075-0b0f35529c2e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:39.544148 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-69571860-9135-4af0-a6d9-cb68a9021c2c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:39.561712 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-69571860-9135-4af0-a6d9-cb68a9021c2c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.381118 Oct 06 12:25:39.563015 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 212/431] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:39 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:39.590515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-954bb1dd-76ce-4bc0-b075-0b0f35529c2e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:39.609911 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-954bb1dd-76ce-4bc0-b075-0b0f35529c2e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1370 microversion: 2.1 time: 0.386545 Oct 06 12:25:39.610524 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 220/432] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:39 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1370 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:39.798833 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-64e3f3bb-5c9a-46b2-95f1-ff9f493a5c51 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:39.800501 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-64e3f3bb-5c9a-46b2-95f1-ff9f493a5c51 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:39.810972 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64e3f3bb-5c9a-46b2-95f1-ff9f493a5c51 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:39.811645 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64e3f3bb-5c9a-46b2-95f1-ff9f493a5c51 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:39.812183 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64e3f3bb-5c9a-46b2-95f1-ff9f493a5c51 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:39.812986 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64e3f3bb-5c9a-46b2-95f1-ff9f493a5c51 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:39.813606 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64e3f3bb-5c9a-46b2-95f1-ff9f493a5c51 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:39.814126 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64e3f3bb-5c9a-46b2-95f1-ff9f493a5c51 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:39.854717 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-81d0f3a2-3adf-4ea5-9e3d-68ce5325285e req-15258548-7c57-487c-9896-31307b9aedf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8e72d3-918b-4046-897d-e7c3f5a5913c", "name": "network-vif-plugged", "status": "completed", "tag": "5fc05d61-8835-4816-b8ac-5f557c8e0fdb"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:39.884305 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-81d0f3a2-3adf-4ea5-9e3d-68ce5325285e req-15258548-7c57-487c-9896-31307b9aedf6 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:39.884912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-81d0f3a2-3adf-4ea5-9e3d-68ce5325285e req-15258548-7c57-487c-9896-31307b9aedf6 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:39.885547 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-81d0f3a2-3adf-4ea5-9e3d-68ce5325285e req-15258548-7c57-487c-9896-31307b9aedf6 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:39.945347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-81d0f3a2-3adf-4ea5-9e3d-68ce5325285e req-15258548-7c57-487c-9896-31307b9aedf6 service nova] Creating event network-vif-plugged:5fc05d61-8835-4816-b8ac-5f557c8e0fdb for instance 0d8e72d3-918b-4046-897d-e7c3f5a5913c on hv-cinder-85604 Oct 06 12:25:39.952886 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-81d0f3a2-3adf-4ea5-9e3d-68ce5325285e req-15258548-7c57-487c-9896-31307b9aedf6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102050 Oct 06 12:25:39.955929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 221/433] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:25:40.141456 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-64e3f3bb-5c9a-46b2-95f1-ff9f493a5c51 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:40.155031 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-64e3f3bb-5c9a-46b2-95f1-ff9f493a5c51 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1314 microversion: 2.1 time: 0.360645 Oct 06 12:25:40.155930 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 213/434] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:39 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:40.177562 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-9e92834f-da5f-4805-ad41-2fbba5ccfb75 req-a76b2193-ad5d-4642-8ddd-f0bc8c5f5ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fc250a5-1327-420b-bb97-d216396d2b73", "tag": "a780075c-a2ca-45cd-b0e5-d55fa7367adc"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:40.188969 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-9e92834f-da5f-4805-ad41-2fbba5ccfb75 req-a76b2193-ad5d-4642-8ddd-f0bc8c5f5ef0 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:40.208242 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-9e92834f-da5f-4805-ad41-2fbba5ccfb75 req-a76b2193-ad5d-4642-8ddd-f0bc8c5f5ef0 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:40.208709 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-9e92834f-da5f-4805-ad41-2fbba5ccfb75 req-a76b2193-ad5d-4642-8ddd-f0bc8c5f5ef0 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:40.226683 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-9e92834f-da5f-4805-ad41-2fbba5ccfb75 req-a76b2193-ad5d-4642-8ddd-f0bc8c5f5ef0 service nova] Creating event network-changed:a780075c-a2ca-45cd-b0e5-d55fa7367adc for instance 6fc250a5-1327-420b-bb97-d216396d2b73 on hv-cinder-85604 Oct 06 12:25:40.233625 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-9e92834f-da5f-4805-ad41-2fbba5ccfb75 req-a76b2193-ad5d-4642-8ddd-f0bc8c5f5ef0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060374 Oct 06 12:25:40.234844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 222/435] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:25:40.586987 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-6415d00d-2b0a-4fe2-a439-4f05bcc0cfda tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:40.588541 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-6415d00d-2b0a-4fe2-a439-4f05bcc0cfda tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:40.599772 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6415d00d-2b0a-4fe2-a439-4f05bcc0cfda tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:40.600664 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6415d00d-2b0a-4fe2-a439-4f05bcc0cfda tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:40.601325 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6415d00d-2b0a-4fe2-a439-4f05bcc0cfda tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:40.602335 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6415d00d-2b0a-4fe2-a439-4f05bcc0cfda tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:40.603007 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6415d00d-2b0a-4fe2-a439-4f05bcc0cfda tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:40.603679 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6415d00d-2b0a-4fe2-a439-4f05bcc0cfda tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:40.638297 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a2fd47fd-4176-4d20-8483-a25faf27e1af tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:40.639206 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a2fd47fd-4176-4d20-8483-a25faf27e1af tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:40.653255 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a2fd47fd-4176-4d20-8483-a25faf27e1af tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:40.654041 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a2fd47fd-4176-4d20-8483-a25faf27e1af tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:40.654661 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a2fd47fd-4176-4d20-8483-a25faf27e1af tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:40.655576 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a2fd47fd-4176-4d20-8483-a25faf27e1af tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:40.656449 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a2fd47fd-4176-4d20-8483-a25faf27e1af tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:40.657820 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a2fd47fd-4176-4d20-8483-a25faf27e1af tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:41.101410 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-6415d00d-2b0a-4fe2-a439-4f05bcc0cfda tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:41.116188 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-6415d00d-2b0a-4fe2-a439-4f05bcc0cfda tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.534701 Oct 06 12:25:41.116804 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 214/436] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:40 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:41.178503 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7e1521b8-45c7-49fd-b016-85f328d4eb39 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:41.179118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7e1521b8-45c7-49fd-b016-85f328d4eb39 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:41.182195 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a2fd47fd-4176-4d20-8483-a25faf27e1af tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:41.201392 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7e1521b8-45c7-49fd-b016-85f328d4eb39 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:41.201892 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7e1521b8-45c7-49fd-b016-85f328d4eb39 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:41.203009 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a2fd47fd-4176-4d20-8483-a25faf27e1af tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1563 microversion: 2.1 time: 0.572373 Oct 06 12:25:41.205175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 223/437] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:40 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1563 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:41.208032 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7e1521b8-45c7-49fd-b016-85f328d4eb39 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:41.208795 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7e1521b8-45c7-49fd-b016-85f328d4eb39 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:41.209258 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7e1521b8-45c7-49fd-b016-85f328d4eb39 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:41.213566 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7e1521b8-45c7-49fd-b016-85f328d4eb39 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:41.229665 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3c49615a-ea14-453b-a3f4-d9dbf52eb492 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:41.230987 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3c49615a-ea14-453b-a3f4-d9dbf52eb492 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:41.243178 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3c49615a-ea14-453b-a3f4-d9dbf52eb492 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:41.244075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3c49615a-ea14-453b-a3f4-d9dbf52eb492 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:41.245214 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3c49615a-ea14-453b-a3f4-d9dbf52eb492 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:41.248723 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3c49615a-ea14-453b-a3f4-d9dbf52eb492 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:41.249467 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3c49615a-ea14-453b-a3f4-d9dbf52eb492 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:41.250141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3c49615a-ea14-453b-a3f4-d9dbf52eb492 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:41.451705 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3c49615a-ea14-453b-a3f4-d9dbf52eb492 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.225620 Oct 06 12:25:41.452329 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 224/438] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 12:25:41 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-interface => generated 284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:25:41.507725 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7e1521b8-45c7-49fd-b016-85f328d4eb39 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:41.518611 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7e1521b8-45c7-49fd-b016-85f328d4eb39 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1314 microversion: 2.1 time: 0.343934 Oct 06 12:25:41.539934 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 215/439] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:41 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:42.144666 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-eb8ea897-7f1c-44ec-b574-dd3bd864a9ac tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:42.146346 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-eb8ea897-7f1c-44ec-b574-dd3bd864a9ac tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:42.159266 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eb8ea897-7f1c-44ec-b574-dd3bd864a9ac tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:42.160514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eb8ea897-7f1c-44ec-b574-dd3bd864a9ac tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:42.161027 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eb8ea897-7f1c-44ec-b574-dd3bd864a9ac tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:42.161815 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eb8ea897-7f1c-44ec-b574-dd3bd864a9ac tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:42.162349 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eb8ea897-7f1c-44ec-b574-dd3bd864a9ac tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:42.163488 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eb8ea897-7f1c-44ec-b574-dd3bd864a9ac tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:42.419328 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-eb8ea897-7f1c-44ec-b574-dd3bd864a9ac tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:42.441819 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-eb8ea897-7f1c-44ec-b574-dd3bd864a9ac tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.300891 Oct 06 12:25:42.462093 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 225/440] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:42 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:42.554260 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c44394df-99dd-43e0-b8a3-fb260c7a656c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:42.554856 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c44394df-99dd-43e0-b8a3-fb260c7a656c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:42.572697 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c44394df-99dd-43e0-b8a3-fb260c7a656c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:42.573441 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c44394df-99dd-43e0-b8a3-fb260c7a656c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:42.574539 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c44394df-99dd-43e0-b8a3-fb260c7a656c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:42.575720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c44394df-99dd-43e0-b8a3-fb260c7a656c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:42.576526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c44394df-99dd-43e0-b8a3-fb260c7a656c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:42.577184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c44394df-99dd-43e0-b8a3-fb260c7a656c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:42.831267 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c44394df-99dd-43e0-b8a3-fb260c7a656c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:42.841097 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c44394df-99dd-43e0-b8a3-fb260c7a656c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1314 microversion: 2.1 time: 0.290692 Oct 06 12:25:42.855558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 216/441] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:42 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:43.325354 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-2b34eb69-9576-4710-86cc-dbecbba7e743 req-636b154a-18f3-4d30-95f7-ddfd5c7333ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1620fb3a-f872-41f2-83d2-909fbe71f438", "tag": "02cb1ceb-4a00-4f6e-8fe3-e8409283f314"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:43.336879 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-2b34eb69-9576-4710-86cc-dbecbba7e743 req-636b154a-18f3-4d30-95f7-ddfd5c7333ac service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:43.337821 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-2b34eb69-9576-4710-86cc-dbecbba7e743 req-636b154a-18f3-4d30-95f7-ddfd5c7333ac service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:43.338394 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-2b34eb69-9576-4710-86cc-dbecbba7e743 req-636b154a-18f3-4d30-95f7-ddfd5c7333ac service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:43.351224 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-2b34eb69-9576-4710-86cc-dbecbba7e743 req-636b154a-18f3-4d30-95f7-ddfd5c7333ac service nova] Creating event network-changed:02cb1ceb-4a00-4f6e-8fe3-e8409283f314 for instance 1620fb3a-f872-41f2-83d2-909fbe71f438 on hv-cinder-85604 Oct 06 12:25:43.356938 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-2b34eb69-9576-4710-86cc-dbecbba7e743 req-636b154a-18f3-4d30-95f7-ddfd5c7333ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035229 Oct 06 12:25:43.358200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 226/442] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:25:43.465733 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-62bb1304-6bbb-4306-a615-874bd48b4206 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:43.466710 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-62bb1304-6bbb-4306-a615-874bd48b4206 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:43.473158 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-62bb1304-6bbb-4306-a615-874bd48b4206 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:43.474420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-62bb1304-6bbb-4306-a615-874bd48b4206 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:43.475363 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-62bb1304-6bbb-4306-a615-874bd48b4206 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:43.477044 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-62bb1304-6bbb-4306-a615-874bd48b4206 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:43.477841 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-62bb1304-6bbb-4306-a615-874bd48b4206 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:43.478425 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-62bb1304-6bbb-4306-a615-874bd48b4206 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:43.865866 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5c70e507-82e3-4f82-8baa-6072234d8063 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:43.867225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5c70e507-82e3-4f82-8baa-6072234d8063 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:43.875295 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c70e507-82e3-4f82-8baa-6072234d8063 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:43.876698 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c70e507-82e3-4f82-8baa-6072234d8063 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:43.877311 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c70e507-82e3-4f82-8baa-6072234d8063 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:43.878957 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c70e507-82e3-4f82-8baa-6072234d8063 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:43.879651 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c70e507-82e3-4f82-8baa-6072234d8063 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:43.880252 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c70e507-82e3-4f82-8baa-6072234d8063 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:43.969299 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:44.001316 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=6 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:44.156077 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-62bb1304-6bbb-4306-a615-874bd48b4206 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:44.164667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-62bb1304-6bbb-4306-a615-874bd48b4206 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.703019 Oct 06 12:25:44.176710 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 217/443] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:43 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:44.250048 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5c70e507-82e3-4f82-8baa-6072234d8063 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:44.283475 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5c70e507-82e3-4f82-8baa-6072234d8063 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1497 microversion: 2.1 time: 0.422257 Oct 06 12:25:44.284795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 227/444] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:43 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1497 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:45.189041 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-56b0709b-bbb4-42e0-a852-eef4dea60fdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:45.189589 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-56b0709b-bbb4-42e0-a852-eef4dea60fdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:45.191769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=6 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:45.197893 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-56b0709b-bbb4-42e0-a852-eef4dea60fdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:45.198410 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-56b0709b-bbb4-42e0-a852-eef4dea60fdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:45.198845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-56b0709b-bbb4-42e0-a852-eef4dea60fdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:45.199552 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-56b0709b-bbb4-42e0-a852-eef4dea60fdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:45.200172 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-56b0709b-bbb4-42e0-a852-eef4dea60fdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:45.200778 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-56b0709b-bbb4-42e0-a852-eef4dea60fdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:45.351961 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-56b0709b-bbb4-42e0-a852-eef4dea60fdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:45.360887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-56b0709b-bbb4-42e0-a852-eef4dea60fdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.175744 Oct 06 12:25:45.362106 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 218/445] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:45 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:45.933648 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0972f3c0-3f66-49df-b807-ba639be79d91 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:45.934232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-0972f3c0-3f66-49df-b807-ba639be79d91 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:45.941495 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0972f3c0-3f66-49df-b807-ba639be79d91 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:45.946993 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0972f3c0-3f66-49df-b807-ba639be79d91 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:45.947538 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0972f3c0-3f66-49df-b807-ba639be79d91 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:45.948404 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0972f3c0-3f66-49df-b807-ba639be79d91 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:45.949073 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0972f3c0-3f66-49df-b807-ba639be79d91 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:45.949725 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0972f3c0-3f66-49df-b807-ba639be79d91 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:45.977161 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-0972f3c0-3f66-49df-b807-ba639be79d91 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Going to try to terminate instance {{(pid=120508) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:25:46.063100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-0972f3c0-3f66-49df-b807-ba639be79d91 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 204 len: 0 microversion: 2.1 time: 0.133296 Oct 06 12:25:46.064314 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 228/446] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:25:45 2022] DELETE /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 12:25:46.074836 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-870e2d22-3f44-49f0-85d6-f403e3cdfdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:46.075622 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-870e2d22-3f44-49f0-85d6-f403e3cdfdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:46.082194 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-870e2d22-3f44-49f0-85d6-f403e3cdfdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:46.082938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-870e2d22-3f44-49f0-85d6-f403e3cdfdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:46.083622 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-870e2d22-3f44-49f0-85d6-f403e3cdfdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:46.084653 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-870e2d22-3f44-49f0-85d6-f403e3cdfdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:46.085307 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-870e2d22-3f44-49f0-85d6-f403e3cdfdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:46.085944 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-870e2d22-3f44-49f0-85d6-f403e3cdfdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:46.230422 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-870e2d22-3f44-49f0-85d6-f403e3cdfdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:46.241852 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-870e2d22-3f44-49f0-85d6-f403e3cdfdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1503 microversion: 2.1 time: 0.173144 Oct 06 12:25:46.255567 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 219/447] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:46 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:46.386734 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-34456fb5-fa96-4e3e-8546-064dae71c8c6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:46.387543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-34456fb5-fa96-4e3e-8546-064dae71c8c6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:46.394662 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-34456fb5-fa96-4e3e-8546-064dae71c8c6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:46.395217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-34456fb5-fa96-4e3e-8546-064dae71c8c6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:46.395682 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-34456fb5-fa96-4e3e-8546-064dae71c8c6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:46.396539 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-34456fb5-fa96-4e3e-8546-064dae71c8c6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:46.397149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-34456fb5-fa96-4e3e-8546-064dae71c8c6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:46.397747 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-34456fb5-fa96-4e3e-8546-064dae71c8c6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:46.546884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-34456fb5-fa96-4e3e-8546-064dae71c8c6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:46.556230 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-34456fb5-fa96-4e3e-8546-064dae71c8c6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.175797 Oct 06 12:25:46.568246 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 229/448] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:46 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:47.266546 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-69e17840-b80f-4ee4-be7e-1e0d4be0cdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:47.267166 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-69e17840-b80f-4ee4-be7e-1e0d4be0cdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:47.273415 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69e17840-b80f-4ee4-be7e-1e0d4be0cdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:47.273938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69e17840-b80f-4ee4-be7e-1e0d4be0cdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:47.274368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69e17840-b80f-4ee4-be7e-1e0d4be0cdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:47.275065 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69e17840-b80f-4ee4-be7e-1e0d4be0cdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:47.275538 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69e17840-b80f-4ee4-be7e-1e0d4be0cdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:47.275953 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-69e17840-b80f-4ee4-be7e-1e0d4be0cdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:47.280370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=100 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:47.419295 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-69e17840-b80f-4ee4-be7e-1e0d4be0cdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:47.434407 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-69e17840-b80f-4ee4-be7e-1e0d4be0cdac tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1503 microversion: 2.1 time: 0.171767 Oct 06 12:25:47.436821 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 220/449] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:47 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:47.579585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-38fc912e-4b85-423f-812b-57d5a1ae2d5c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:47.580187 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-38fc912e-4b85-423f-812b-57d5a1ae2d5c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:47.587412 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-38fc912e-4b85-423f-812b-57d5a1ae2d5c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:47.588133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-38fc912e-4b85-423f-812b-57d5a1ae2d5c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:47.588728 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-38fc912e-4b85-423f-812b-57d5a1ae2d5c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:47.591335 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-38fc912e-4b85-423f-812b-57d5a1ae2d5c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:47.591877 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-38fc912e-4b85-423f-812b-57d5a1ae2d5c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:47.592315 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-38fc912e-4b85-423f-812b-57d5a1ae2d5c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:47.741271 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-38fc912e-4b85-423f-812b-57d5a1ae2d5c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:47.750856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-38fc912e-4b85-423f-812b-57d5a1ae2d5c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.174900 Oct 06 12:25:47.751764 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 230/450] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:47 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:48.049386 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c5aaac14-aa10-44c6-b807-f36f942355ef tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Action: 'create', calling method: .version_select at 0x7f03aae024c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1455950167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOppYUT4b/dFakqWhIaAHbUtVr+iEwwjaCmeT5y5QyqTjDN1er2w513qmbcBG133BPnx680qrY1C3cJhKGwG1DJJ2WnHjx12j8pK6IL/EPK0Aiw0hbtzX8PylStnZWedRg=="}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:48.066591 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-c5aaac14-aa10-44c6-b807-f36f942355ef tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Getting quotas for project 1c822fb7252b4804aa9a0cb228b6397c. Resources: {'key_pairs'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:25:48.070153 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-c5aaac14-aa10-44c6-b807-f36f942355ef tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Getting quotas for user 196f71447aaf45fd812efb9eeba2c0cb and project 1c822fb7252b4804aa9a0cb228b6397c. Resources: {'key_pairs'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:25:48.090734 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c5aaac14-aa10-44c6-b807-f36f942355ef tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045212 Oct 06 12:25:48.091531 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 221/451] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 12:25:48 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:25:48.141839 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1054458822", "imageRef": "7fb2d4dd-dd7d-446e-b120-73d4f3062bdd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1455950167", "networks": [{"uuid": "7aa9c50e-f953-474e-a8eb-45316afa3b7b"}]}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:48.192989 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.network.neutron [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] validate_networks() for [('7aa9c50e-f953-474e-a8eb-45316afa3b7b', None, None, None, None, None)] {{(pid=120508) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:25:48.461478 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e67c0a8a-867d-4f2d-89d6-c321e761be69 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:48.462087 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e67c0a8a-867d-4f2d-89d6-c321e761be69 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:48.468317 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e67c0a8a-867d-4f2d-89d6-c321e761be69 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:48.468831 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e67c0a8a-867d-4f2d-89d6-c321e761be69 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:48.469265 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e67c0a8a-867d-4f2d-89d6-c321e761be69 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:48.470042 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e67c0a8a-867d-4f2d-89d6-c321e761be69 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:48.470494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e67c0a8a-867d-4f2d-89d6-c321e761be69 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:48.470944 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e67c0a8a-867d-4f2d-89d6-c321e761be69 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:48.605524 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Flavor limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:25:48.606020 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Image limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:25:48.606411 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Flavor pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:25:48.606822 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Image pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:25:48.607280 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:25:48.616313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:48.616801 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:48.617241 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:48.617961 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:48.618417 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:48.618840 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:48.631940 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e67c0a8a-867d-4f2d-89d6-c321e761be69 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:48.635656 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Getting quotas for project 1c822fb7252b4804aa9a0cb228b6397c. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:25:48.639493 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e67c0a8a-867d-4f2d-89d6-c321e761be69 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1503 microversion: 2.1 time: 0.181973 Oct 06 12:25:48.639749 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Getting quotas for user 196f71447aaf45fd812efb9eeba2c0cb and project 1c822fb7252b4804aa9a0cb228b6397c. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:25:48.640076 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 222/452] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:48 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:48.651175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Going to run 1 instances... {{(pid=120508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:25:48.653426 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb2d4dd-dd7d-446e-b120-73d4f3062bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:25:48.664522 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:48.698254 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-49744055-0d74-4d12-8855-56b8f6b579d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560293 Oct 06 12:25:48.699054 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 231/453] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:25:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 12:25:48.710214 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8d4ac2eb-d3da-4480-9a44-4388f6146cd9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:48.710813 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8d4ac2eb-d3da-4480-9a44-4388f6146cd9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:48.774593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3912dcc6-c835-49e3-ae4e-37b2514389b4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:48.775437 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8d4ac2eb-d3da-4480-9a44-4388f6146cd9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:48.775624 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3912dcc6-c835-49e3-ae4e-37b2514389b4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:48.783343 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8d4ac2eb-d3da-4480-9a44-4388f6146cd9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1259 microversion: 2.1 time: 0.077467 Oct 06 12:25:48.783610 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3912dcc6-c835-49e3-ae4e-37b2514389b4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:48.784547 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 223/454] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:48 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1259 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:48.785104 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3912dcc6-c835-49e3-ae4e-37b2514389b4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:48.785713 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3912dcc6-c835-49e3-ae4e-37b2514389b4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:48.786573 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3912dcc6-c835-49e3-ae4e-37b2514389b4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:48.787891 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3912dcc6-c835-49e3-ae4e-37b2514389b4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:48.788422 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3912dcc6-c835-49e3-ae4e-37b2514389b4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:48.925825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3912dcc6-c835-49e3-ae4e-37b2514389b4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:48.933796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3912dcc6-c835-49e3-ae4e-37b2514389b4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.163012 Oct 06 12:25:48.934659 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 232/455] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:48 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:49.662734 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-32b401d6-13fc-46c0-ae0a-ba18352523fa tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:49.663407 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-32b401d6-13fc-46c0-ae0a-ba18352523fa tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:49.669699 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-32b401d6-13fc-46c0-ae0a-ba18352523fa tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:49.670184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-32b401d6-13fc-46c0-ae0a-ba18352523fa tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:49.670619 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-32b401d6-13fc-46c0-ae0a-ba18352523fa tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:49.671309 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-32b401d6-13fc-46c0-ae0a-ba18352523fa tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:49.671794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-32b401d6-13fc-46c0-ae0a-ba18352523fa tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:49.672220 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-32b401d6-13fc-46c0-ae0a-ba18352523fa tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:49.801736 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-32b401d6-13fc-46c0-ae0a-ba18352523fa tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:49.806881 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-867927be-f847-4371-9210-edfad10b9967 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:49.807669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-867927be-f847-4371-9210-edfad10b9967 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:49.809895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-32b401d6-13fc-46c0-ae0a-ba18352523fa tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1503 microversion: 2.1 time: 0.151073 Oct 06 12:25:49.810542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 224/456] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:49 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:49.816982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-867927be-f847-4371-9210-edfad10b9967 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:49.816982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-867927be-f847-4371-9210-edfad10b9967 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:49.816982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-867927be-f847-4371-9210-edfad10b9967 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:49.816982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-867927be-f847-4371-9210-edfad10b9967 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:49.817340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-867927be-f847-4371-9210-edfad10b9967 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:49.817601 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-867927be-f847-4371-9210-edfad10b9967 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:49.881096 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-867927be-f847-4371-9210-edfad10b9967 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:49.888709 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-867927be-f847-4371-9210-edfad10b9967 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1311 microversion: 2.1 time: 0.085724 Oct 06 12:25:49.889399 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 233/457] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:49 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:49.956679 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ba119c1f-ae08-44d3-8b4f-e076929d130f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:49.957403 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ba119c1f-ae08-44d3-8b4f-e076929d130f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:49.964228 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ba119c1f-ae08-44d3-8b4f-e076929d130f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:49.964766 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ba119c1f-ae08-44d3-8b4f-e076929d130f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:49.965202 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ba119c1f-ae08-44d3-8b4f-e076929d130f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:49.965936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ba119c1f-ae08-44d3-8b4f-e076929d130f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:49.966386 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ba119c1f-ae08-44d3-8b4f-e076929d130f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:49.966802 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ba119c1f-ae08-44d3-8b4f-e076929d130f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:50.095481 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ba119c1f-ae08-44d3-8b4f-e076929d130f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:50.103868 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ba119c1f-ae08-44d3-8b4f-e076929d130f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.151174 Oct 06 12:25:50.104433 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 225/458] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:49 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:50.587736 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-6db414a8-d300-4626-8554-3a628a77dc41 req-2d649fa3-4e9a-4d15-91a5-b5bedef0f1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8e72d3-918b-4046-897d-e7c3f5a5913c", "name": "network-vif-deleted", "tag": "5fc05d61-8835-4816-b8ac-5f557c8e0fdb"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:50.597740 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-6db414a8-d300-4626-8554-3a628a77dc41 req-2d649fa3-4e9a-4d15-91a5-b5bedef0f1e2 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:50.598218 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-6db414a8-d300-4626-8554-3a628a77dc41 req-2d649fa3-4e9a-4d15-91a5-b5bedef0f1e2 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:50.598648 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-6db414a8-d300-4626-8554-3a628a77dc41 req-2d649fa3-4e9a-4d15-91a5-b5bedef0f1e2 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:50.609498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-6db414a8-d300-4626-8554-3a628a77dc41 req-2d649fa3-4e9a-4d15-91a5-b5bedef0f1e2 service nova] Creating event network-vif-deleted:5fc05d61-8835-4816-b8ac-5f557c8e0fdb for instance 0d8e72d3-918b-4046-897d-e7c3f5a5913c on hv-cinder-85604 Oct 06 12:25:50.614719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-6db414a8-d300-4626-8554-3a628a77dc41 req-2d649fa3-4e9a-4d15-91a5-b5bedef0f1e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030682 Oct 06 12:25:50.615311 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 234/459] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:25:50.834247 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-729776f8-5925-402e-b6dc-2942c6599768 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:50.834860 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-729776f8-5925-402e-b6dc-2942c6599768 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:50.836752 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:50.841951 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-729776f8-5925-402e-b6dc-2942c6599768 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:50.842430 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-729776f8-5925-402e-b6dc-2942c6599768 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:50.842868 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-729776f8-5925-402e-b6dc-2942c6599768 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:50.843588 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-729776f8-5925-402e-b6dc-2942c6599768 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:50.844023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-729776f8-5925-402e-b6dc-2942c6599768 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:50.844446 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-729776f8-5925-402e-b6dc-2942c6599768 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:50.879584 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-729776f8-5925-402e-b6dc-2942c6599768 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:50.879978 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-729776f8-5925-402e-b6dc-2942c6599768 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:50.880408 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-729776f8-5925-402e-b6dc-2942c6599768 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:50.880853 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-729776f8-5925-402e-b6dc-2942c6599768 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:25:50.912906 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5e497344-81f7-4667-8e48-9b1879d78c87 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:50.914041 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5e497344-81f7-4667-8e48-9b1879d78c87 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:50.921817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5e497344-81f7-4667-8e48-9b1879d78c87 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:50.922905 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5e497344-81f7-4667-8e48-9b1879d78c87 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:50.923582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5e497344-81f7-4667-8e48-9b1879d78c87 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:50.924510 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5e497344-81f7-4667-8e48-9b1879d78c87 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:50.925207 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5e497344-81f7-4667-8e48-9b1879d78c87 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:50.925849 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5e497344-81f7-4667-8e48-9b1879d78c87 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:50.942065 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-729776f8-5925-402e-b6dc-2942c6599768 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:50.947741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:50.950290 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-729776f8-5925-402e-b6dc-2942c6599768 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.120257 Oct 06 12:25:50.964267 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 226/460] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:50 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:51.037008 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5e497344-81f7-4667-8e48-9b1879d78c87 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:51.047981 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5e497344-81f7-4667-8e48-9b1879d78c87 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1329 microversion: 2.1 time: 0.140023 Oct 06 12:25:51.049490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 235/461] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:50 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1329 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:51.126512 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-065c25e6-d892-4a21-a111-fef20e73b74c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:51.127230 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-065c25e6-d892-4a21-a111-fef20e73b74c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:51.133830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-065c25e6-d892-4a21-a111-fef20e73b74c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:51.134250 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-065c25e6-d892-4a21-a111-fef20e73b74c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:51.134675 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-065c25e6-d892-4a21-a111-fef20e73b74c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:51.135364 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-065c25e6-d892-4a21-a111-fef20e73b74c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:51.135844 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-065c25e6-d892-4a21-a111-fef20e73b74c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:51.136273 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-065c25e6-d892-4a21-a111-fef20e73b74c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:51.349914 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-065c25e6-d892-4a21-a111-fef20e73b74c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:51.360666 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-065c25e6-d892-4a21-a111-fef20e73b74c tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.236071 Oct 06 12:25:51.361295 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 227/462] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:51 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:51.977190 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f6c032c7-c67a-43cf-8801-f1bf1f2e5d9c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:51.977808 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f6c032c7-c67a-43cf-8801-f1bf1f2e5d9c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:51.984599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6c032c7-c67a-43cf-8801-f1bf1f2e5d9c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:51.985353 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6c032c7-c67a-43cf-8801-f1bf1f2e5d9c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:51.985796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6c032c7-c67a-43cf-8801-f1bf1f2e5d9c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:51.986535 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6c032c7-c67a-43cf-8801-f1bf1f2e5d9c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:51.986998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6c032c7-c67a-43cf-8801-f1bf1f2e5d9c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:51.987953 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6c032c7-c67a-43cf-8801-f1bf1f2e5d9c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:52.021139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6c032c7-c67a-43cf-8801-f1bf1f2e5d9c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:52.021631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6c032c7-c67a-43cf-8801-f1bf1f2e5d9c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:52.022070 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6c032c7-c67a-43cf-8801-f1bf1f2e5d9c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:52.022534 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-f6c032c7-c67a-43cf-8801-f1bf1f2e5d9c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:25:52.073971 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5623b977-9efc-426f-b691-24ce9738e8d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:52.074665 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5623b977-9efc-426f-b691-24ce9738e8d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:52.083960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5623b977-9efc-426f-b691-24ce9738e8d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:52.100295 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5623b977-9efc-426f-b691-24ce9738e8d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:52.100852 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5623b977-9efc-426f-b691-24ce9738e8d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:52.101720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5623b977-9efc-426f-b691-24ce9738e8d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:52.102471 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5623b977-9efc-426f-b691-24ce9738e8d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:52.103020 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5623b977-9efc-426f-b691-24ce9738e8d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:52.107019 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f6c032c7-c67a-43cf-8801-f1bf1f2e5d9c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:52.117375 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f6c032c7-c67a-43cf-8801-f1bf1f2e5d9c tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.143766 Oct 06 12:25:52.118237 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 236/463] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:51 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:52.242681 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5623b977-9efc-426f-b691-24ce9738e8d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:52.251986 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5623b977-9efc-426f-b691-24ce9738e8d1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.182427 Oct 06 12:25:52.253214 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 228/464] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:52 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:52.340442 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-7bcacb16-ea5f-49df-974b-0fea07ddfdf4 req-50279f2c-bb6e-43dc-8cf5-0432b1648244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fc250a5-1327-420b-bb97-d216396d2b73", "name": "network-vif-plugged", "status": "completed", "tag": "a780075c-a2ca-45cd-b0e5-d55fa7367adc"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:52.350507 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-7bcacb16-ea5f-49df-974b-0fea07ddfdf4 req-50279f2c-bb6e-43dc-8cf5-0432b1648244 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:52.351275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-7bcacb16-ea5f-49df-974b-0fea07ddfdf4 req-50279f2c-bb6e-43dc-8cf5-0432b1648244 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:52.352511 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-7bcacb16-ea5f-49df-974b-0fea07ddfdf4 req-50279f2c-bb6e-43dc-8cf5-0432b1648244 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:52.364468 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-7bcacb16-ea5f-49df-974b-0fea07ddfdf4 req-50279f2c-bb6e-43dc-8cf5-0432b1648244 service nova] Creating event network-vif-plugged:a780075c-a2ca-45cd-b0e5-d55fa7367adc for instance 6fc250a5-1327-420b-bb97-d216396d2b73 on hv-cinder-85604 Oct 06 12:25:52.371748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-7bcacb16-ea5f-49df-974b-0fea07ddfdf4 req-50279f2c-bb6e-43dc-8cf5-0432b1648244 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032558 Oct 06 12:25:52.371748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 237/465] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:25:52.384541 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-693eef43-5e15-44e5-b145-1b9e72754654 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:52.385473 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-693eef43-5e15-44e5-b145-1b9e72754654 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:52.391918 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-693eef43-5e15-44e5-b145-1b9e72754654 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:52.392701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-693eef43-5e15-44e5-b145-1b9e72754654 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:52.393361 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-693eef43-5e15-44e5-b145-1b9e72754654 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:52.394343 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-693eef43-5e15-44e5-b145-1b9e72754654 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:52.395013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-693eef43-5e15-44e5-b145-1b9e72754654 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:52.395690 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-693eef43-5e15-44e5-b145-1b9e72754654 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:52.530798 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-693eef43-5e15-44e5-b145-1b9e72754654 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:52.538721 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-693eef43-5e15-44e5-b145-1b9e72754654 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.157979 Oct 06 12:25:52.539282 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 229/466] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:52 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:53.141796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-cb830bdd-c493-4573-80ce-8c7e32e65f77 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:53.142594 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-cb830bdd-c493-4573-80ce-8c7e32e65f77 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:53.149210 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cb830bdd-c493-4573-80ce-8c7e32e65f77 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:53.149692 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cb830bdd-c493-4573-80ce-8c7e32e65f77 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:53.150289 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cb830bdd-c493-4573-80ce-8c7e32e65f77 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:53.150799 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cb830bdd-c493-4573-80ce-8c7e32e65f77 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:53.151245 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cb830bdd-c493-4573-80ce-8c7e32e65f77 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:53.151697 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cb830bdd-c493-4573-80ce-8c7e32e65f77 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:53.185506 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cb830bdd-c493-4573-80ce-8c7e32e65f77 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:53.185995 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cb830bdd-c493-4573-80ce-8c7e32e65f77 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:53.186437 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cb830bdd-c493-4573-80ce-8c7e32e65f77 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:53.186883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-cb830bdd-c493-4573-80ce-8c7e32e65f77 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:25:53.228288 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-cb830bdd-c493-4573-80ce-8c7e32e65f77 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:53.235983 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-cb830bdd-c493-4573-80ce-8c7e32e65f77 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.098850 Oct 06 12:25:53.236552 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 238/467] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:53 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:53.275173 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7d13f4c0-6a16-4c11-88e0-84ed6a3ccc2a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:53.275805 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7d13f4c0-6a16-4c11-88e0-84ed6a3ccc2a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:53.283182 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d13f4c0-6a16-4c11-88e0-84ed6a3ccc2a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:53.283688 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d13f4c0-6a16-4c11-88e0-84ed6a3ccc2a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:53.284169 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d13f4c0-6a16-4c11-88e0-84ed6a3ccc2a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:53.284854 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d13f4c0-6a16-4c11-88e0-84ed6a3ccc2a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:53.285302 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d13f4c0-6a16-4c11-88e0-84ed6a3ccc2a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:53.285717 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d13f4c0-6a16-4c11-88e0-84ed6a3ccc2a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:53.419726 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7d13f4c0-6a16-4c11-88e0-84ed6a3ccc2a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:53.427920 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7d13f4c0-6a16-4c11-88e0-84ed6a3ccc2a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.156608 Oct 06 12:25:53.428479 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 230/468] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:53 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:53.563273 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a25defb3-2181-41d5-bcb5-1f4be4406c45 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:53.564052 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a25defb3-2181-41d5-bcb5-1f4be4406c45 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:53.571398 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a25defb3-2181-41d5-bcb5-1f4be4406c45 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:53.573269 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a25defb3-2181-41d5-bcb5-1f4be4406c45 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:53.573965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a25defb3-2181-41d5-bcb5-1f4be4406c45 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:53.574922 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a25defb3-2181-41d5-bcb5-1f4be4406c45 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:53.575392 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a25defb3-2181-41d5-bcb5-1f4be4406c45 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:53.575849 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a25defb3-2181-41d5-bcb5-1f4be4406c45 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:53.708672 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a25defb3-2181-41d5-bcb5-1f4be4406c45 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:53.716409 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a25defb3-2181-41d5-bcb5-1f4be4406c45 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.158502 Oct 06 12:25:53.717365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 239/469] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:53 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:54.258578 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-51e27644-cabd-45bc-b612-c39f738cd8ef tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:54.259330 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-51e27644-cabd-45bc-b612-c39f738cd8ef tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:54.265564 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-51e27644-cabd-45bc-b612-c39f738cd8ef tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:54.266059 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-51e27644-cabd-45bc-b612-c39f738cd8ef tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:54.266504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-51e27644-cabd-45bc-b612-c39f738cd8ef tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:54.267210 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-51e27644-cabd-45bc-b612-c39f738cd8ef tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:54.267699 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-51e27644-cabd-45bc-b612-c39f738cd8ef tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:54.268126 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-51e27644-cabd-45bc-b612-c39f738cd8ef tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:54.300389 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-51e27644-cabd-45bc-b612-c39f738cd8ef tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:54.301036 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-51e27644-cabd-45bc-b612-c39f738cd8ef tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:54.301292 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-51e27644-cabd-45bc-b612-c39f738cd8ef tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:54.301731 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-51e27644-cabd-45bc-b612-c39f738cd8ef tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:25:54.341428 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-51e27644-cabd-45bc-b612-c39f738cd8ef tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:54.349711 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-51e27644-cabd-45bc-b612-c39f738cd8ef tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.094944 Oct 06 12:25:54.350289 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 231/470] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:54 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:54.452605 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-191e9a3c-f766-44bf-a672-4831733e6ecd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:54.453152 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-191e9a3c-f766-44bf-a672-4831733e6ecd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:54.461073 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-191e9a3c-f766-44bf-a672-4831733e6ecd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:54.461647 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-191e9a3c-f766-44bf-a672-4831733e6ecd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:54.462199 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-191e9a3c-f766-44bf-a672-4831733e6ecd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:54.462972 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-191e9a3c-f766-44bf-a672-4831733e6ecd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:54.463561 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-191e9a3c-f766-44bf-a672-4831733e6ecd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:54.464059 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-191e9a3c-f766-44bf-a672-4831733e6ecd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:54.595649 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-191e9a3c-f766-44bf-a672-4831733e6ecd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:54.603929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-191e9a3c-f766-44bf-a672-4831733e6ecd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.155461 Oct 06 12:25:54.604696 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 240/471] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:54 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:54.739405 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4448cc84-0806-418e-9022-07917be1303e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:54.739968 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4448cc84-0806-418e-9022-07917be1303e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:54.745841 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4448cc84-0806-418e-9022-07917be1303e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:54.746324 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4448cc84-0806-418e-9022-07917be1303e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:54.746759 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4448cc84-0806-418e-9022-07917be1303e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:54.747439 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4448cc84-0806-418e-9022-07917be1303e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:54.747919 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4448cc84-0806-418e-9022-07917be1303e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:54.748338 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4448cc84-0806-418e-9022-07917be1303e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:54.880043 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4448cc84-0806-418e-9022-07917be1303e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:54.887978 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4448cc84-0806-418e-9022-07917be1303e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.152441 Oct 06 12:25:54.888756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 232/472] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:54 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:55.372895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0641607a-469e-41ed-aa0f-8db901cc3c6f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:55.373535 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-0641607a-469e-41ed-aa0f-8db901cc3c6f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:55.380025 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0641607a-469e-41ed-aa0f-8db901cc3c6f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:55.380511 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0641607a-469e-41ed-aa0f-8db901cc3c6f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:55.380944 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0641607a-469e-41ed-aa0f-8db901cc3c6f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:55.381629 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0641607a-469e-41ed-aa0f-8db901cc3c6f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:55.382085 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0641607a-469e-41ed-aa0f-8db901cc3c6f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:55.382510 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0641607a-469e-41ed-aa0f-8db901cc3c6f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:55.414756 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0641607a-469e-41ed-aa0f-8db901cc3c6f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:55.415240 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0641607a-469e-41ed-aa0f-8db901cc3c6f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:55.415724 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0641607a-469e-41ed-aa0f-8db901cc3c6f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:55.416173 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-0641607a-469e-41ed-aa0f-8db901cc3c6f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:25:55.457314 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-0641607a-469e-41ed-aa0f-8db901cc3c6f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:55.465779 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-0641607a-469e-41ed-aa0f-8db901cc3c6f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.096751 Oct 06 12:25:55.466586 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 241/473] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:55 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:55.627454 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-24a1a435-c492-41d5-94aa-4715fce36b6c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:55.628639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-24a1a435-c492-41d5-94aa-4715fce36b6c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:55.634952 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-24a1a435-c492-41d5-94aa-4715fce36b6c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:55.635433 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-24a1a435-c492-41d5-94aa-4715fce36b6c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:55.635885 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-24a1a435-c492-41d5-94aa-4715fce36b6c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:55.636579 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-24a1a435-c492-41d5-94aa-4715fce36b6c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:55.637026 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-24a1a435-c492-41d5-94aa-4715fce36b6c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:55.637447 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-24a1a435-c492-41d5-94aa-4715fce36b6c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:55.769781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-24a1a435-c492-41d5-94aa-4715fce36b6c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:55.777765 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-24a1a435-c492-41d5-94aa-4715fce36b6c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.154103 Oct 06 12:25:55.778534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 233/474] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:55 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:55.912119 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-48d02bb7-178b-4241-8ed8-981cdf1f2766 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:55.912728 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-48d02bb7-178b-4241-8ed8-981cdf1f2766 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:55.918989 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-48d02bb7-178b-4241-8ed8-981cdf1f2766 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:55.919472 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-48d02bb7-178b-4241-8ed8-981cdf1f2766 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:55.919937 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-48d02bb7-178b-4241-8ed8-981cdf1f2766 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:55.920617 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-48d02bb7-178b-4241-8ed8-981cdf1f2766 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:55.921072 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-48d02bb7-178b-4241-8ed8-981cdf1f2766 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:55.921495 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-48d02bb7-178b-4241-8ed8-981cdf1f2766 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:56.052995 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-48d02bb7-178b-4241-8ed8-981cdf1f2766 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:56.062140 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-48d02bb7-178b-4241-8ed8-981cdf1f2766 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.154291 Oct 06 12:25:56.062880 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 242/475] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:55 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:56.491422 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-81ef0607-ae9b-4f9d-9e6a-8cd4b7753e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:56.492060 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-81ef0607-ae9b-4f9d-9e6a-8cd4b7753e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:56.498117 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81ef0607-ae9b-4f9d-9e6a-8cd4b7753e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:56.498614 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81ef0607-ae9b-4f9d-9e6a-8cd4b7753e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:56.499046 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81ef0607-ae9b-4f9d-9e6a-8cd4b7753e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:56.499764 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81ef0607-ae9b-4f9d-9e6a-8cd4b7753e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:56.500231 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81ef0607-ae9b-4f9d-9e6a-8cd4b7753e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:56.500642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81ef0607-ae9b-4f9d-9e6a-8cd4b7753e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:56.533186 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81ef0607-ae9b-4f9d-9e6a-8cd4b7753e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:56.533593 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81ef0607-ae9b-4f9d-9e6a-8cd4b7753e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:56.534758 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81ef0607-ae9b-4f9d-9e6a-8cd4b7753e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:56.535254 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-81ef0607-ae9b-4f9d-9e6a-8cd4b7753e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:25:56.575911 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-81ef0607-ae9b-4f9d-9e6a-8cd4b7753e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:56.584300 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-81ef0607-ae9b-4f9d-9e6a-8cd4b7753e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.096808 Oct 06 12:25:56.584977 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 234/476] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:56 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:56.800999 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3496c655-4d7a-461a-9bbf-ad90ed0adb5f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:56.802238 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3496c655-4d7a-461a-9bbf-ad90ed0adb5f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:56.808835 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3496c655-4d7a-461a-9bbf-ad90ed0adb5f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:56.809323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3496c655-4d7a-461a-9bbf-ad90ed0adb5f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:56.809782 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3496c655-4d7a-461a-9bbf-ad90ed0adb5f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:56.810463 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3496c655-4d7a-461a-9bbf-ad90ed0adb5f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:56.810922 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3496c655-4d7a-461a-9bbf-ad90ed0adb5f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:56.811346 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3496c655-4d7a-461a-9bbf-ad90ed0adb5f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:56.946962 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3496c655-4d7a-461a-9bbf-ad90ed0adb5f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:56.956237 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3496c655-4d7a-461a-9bbf-ad90ed0adb5f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.158623 Oct 06 12:25:56.957428 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 243/477] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:56 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:57.085494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-913db328-f049-4064-a203-25f21b006343 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:57.086064 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-913db328-f049-4064-a203-25f21b006343 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:57.091960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-913db328-f049-4064-a203-25f21b006343 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:57.092434 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-913db328-f049-4064-a203-25f21b006343 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:57.092865 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-913db328-f049-4064-a203-25f21b006343 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:57.093542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-913db328-f049-4064-a203-25f21b006343 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:57.093994 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-913db328-f049-4064-a203-25f21b006343 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:57.094413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-913db328-f049-4064-a203-25f21b006343 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:57.228078 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-913db328-f049-4064-a203-25f21b006343 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:57.235676 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-913db328-f049-4064-a203-25f21b006343 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.154470 Oct 06 12:25:57.236243 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 235/478] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:57 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:57.608672 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a9514b52-c826-49b2-add0-a1b5106724ed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:57.609287 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a9514b52-c826-49b2-add0-a1b5106724ed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:57.615901 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a9514b52-c826-49b2-add0-a1b5106724ed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:57.616389 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a9514b52-c826-49b2-add0-a1b5106724ed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:57.616834 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a9514b52-c826-49b2-add0-a1b5106724ed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:57.617514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a9514b52-c826-49b2-add0-a1b5106724ed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:57.617968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a9514b52-c826-49b2-add0-a1b5106724ed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:57.618391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a9514b52-c826-49b2-add0-a1b5106724ed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:57.650054 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a9514b52-c826-49b2-add0-a1b5106724ed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:57.650538 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a9514b52-c826-49b2-add0-a1b5106724ed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:57.650973 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a9514b52-c826-49b2-add0-a1b5106724ed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:57.651417 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-a9514b52-c826-49b2-add0-a1b5106724ed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:25:57.692226 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a9514b52-c826-49b2-add0-a1b5106724ed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:57.699901 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a9514b52-c826-49b2-add0-a1b5106724ed tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.095415 Oct 06 12:25:57.700693 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 244/479] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:57 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:57.979416 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-48b8963c-62eb-42df-88aa-b695c81aa9dc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:57.980118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-48b8963c-62eb-42df-88aa-b695c81aa9dc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:57.986918 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48b8963c-62eb-42df-88aa-b695c81aa9dc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:57.987571 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48b8963c-62eb-42df-88aa-b695c81aa9dc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:57.988110 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48b8963c-62eb-42df-88aa-b695c81aa9dc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:57.989040 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48b8963c-62eb-42df-88aa-b695c81aa9dc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:57.989631 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48b8963c-62eb-42df-88aa-b695c81aa9dc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:57.990171 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48b8963c-62eb-42df-88aa-b695c81aa9dc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:58.121929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-48b8963c-62eb-42df-88aa-b695c81aa9dc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:58.130267 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-48b8963c-62eb-42df-88aa-b695c81aa9dc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.155066 Oct 06 12:25:58.130835 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 236/480] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:57 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:58.258670 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-22fcb86b-269d-4a9e-8abb-ba2a31167163 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:58.259346 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-22fcb86b-269d-4a9e-8abb-ba2a31167163 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:58.265838 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22fcb86b-269d-4a9e-8abb-ba2a31167163 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:58.266362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22fcb86b-269d-4a9e-8abb-ba2a31167163 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:58.266803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22fcb86b-269d-4a9e-8abb-ba2a31167163 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:58.267491 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22fcb86b-269d-4a9e-8abb-ba2a31167163 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:58.267972 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22fcb86b-269d-4a9e-8abb-ba2a31167163 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:58.269027 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22fcb86b-269d-4a9e-8abb-ba2a31167163 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:58.404529 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-22fcb86b-269d-4a9e-8abb-ba2a31167163 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:58.414034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-22fcb86b-269d-4a9e-8abb-ba2a31167163 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.159131 Oct 06 12:25:58.414714 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 245/481] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:58 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:58.590737 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-891551984", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-679794386", "security_groups": [{"name": "tempest-secgroup-smoke-1201469717"}], "block_device_mapping_v2": [{"uuid": "60c2b685-4af7-43ac-9fd8-cd79c847beab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "397bf80c-f529-4030-8ca3-f73bf801b9a0"}]}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:25:58.707778 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.network.neutron [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] validate_networks() for [('397bf80c-f529-4030-8ca3-f73bf801b9a0', None, None, None, None, None)] {{(pid=120509) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:25:58.723257 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4c3b2e56-0007-40d3-bd92-432a2f593426 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:58.724154 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-4c3b2e56-0007-40d3-bd92-432a2f593426 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:58.729979 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:58.730777 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=6 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:58.732779 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4c3b2e56-0007-40d3-bd92-432a2f593426 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:58.733298 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4c3b2e56-0007-40d3-bd92-432a2f593426 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:58.733748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4c3b2e56-0007-40d3-bd92-432a2f593426 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:58.734482 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4c3b2e56-0007-40d3-bd92-432a2f593426 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:58.734941 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4c3b2e56-0007-40d3-bd92-432a2f593426 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:58.735558 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4c3b2e56-0007-40d3-bd92-432a2f593426 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:58.772666 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4c3b2e56-0007-40d3-bd92-432a2f593426 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:58.773300 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4c3b2e56-0007-40d3-bd92-432a2f593426 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:58.773813 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4c3b2e56-0007-40d3-bd92-432a2f593426 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:58.774408 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-4c3b2e56-0007-40d3-bd92-432a2f593426 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:25:58.779617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=6 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:58.831438 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4c3b2e56-0007-40d3-bd92-432a2f593426 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:58.839294 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4c3b2e56-0007-40d3-bd92-432a2f593426 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.119907 Oct 06 12:25:58.840064 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 246/482] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:58 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:59.153268 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c59363b1-d4da-4393-b0d4-7b79f3568ba5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:59.153974 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c59363b1-d4da-4393-b0d4-7b79f3568ba5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:59.160605 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c59363b1-d4da-4393-b0d4-7b79f3568ba5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:59.161166 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c59363b1-d4da-4393-b0d4-7b79f3568ba5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:59.161669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c59363b1-d4da-4393-b0d4-7b79f3568ba5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:59.162424 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c59363b1-d4da-4393-b0d4-7b79f3568ba5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:59.162973 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c59363b1-d4da-4393-b0d4-7b79f3568ba5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:59.163466 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c59363b1-d4da-4393-b0d4-7b79f3568ba5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:59.369090 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c59363b1-d4da-4393-b0d4-7b79f3568ba5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:59.378525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c59363b1-d4da-4393-b0d4-7b79f3568ba5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.228405 Oct 06 12:25:59.381037 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 247/483] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:59 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:59.396975 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Flavor limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:25:59.397466 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Image limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:25:59.397928 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Flavor pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:25:59.398405 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Image pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:25:59.398887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:25:59.409892 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:59.410453 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:59.411153 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:59.412450 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:59.412906 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:59.413336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:59.431982 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Getting quotas for project c80feb95ecbf413ca0bc52a519bf43b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:25:59.436356 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Getting quotas for user dff0daad12c143fabd16d40a1939b87e and project c80feb95ecbf413ca0bc52a519bf43b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:25:59.436638 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-cfebc305-6d44-4dcc-b4fa-5ae38598cdde tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:59.437255 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-cfebc305-6d44-4dcc-b4fa-5ae38598cdde tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:59.449535 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cfebc305-6d44-4dcc-b4fa-5ae38598cdde tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:59.450037 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cfebc305-6d44-4dcc-b4fa-5ae38598cdde tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:59.450472 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cfebc305-6d44-4dcc-b4fa-5ae38598cdde tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:59.451177 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cfebc305-6d44-4dcc-b4fa-5ae38598cdde tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:59.451673 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cfebc305-6d44-4dcc-b4fa-5ae38598cdde tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:59.452101 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cfebc305-6d44-4dcc-b4fa-5ae38598cdde tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:59.497787 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Going to run 1 instances... {{(pid=120509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:25:59.500230 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60c2b685-4af7-43ac-9fd8-cd79c847beab',volume_size=None,volume_type=None)] {{(pid=120509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:25:59.623359 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-cfebc305-6d44-4dcc-b4fa-5ae38598cdde tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:59.631357 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-cfebc305-6d44-4dcc-b4fa-5ae38598cdde tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.198536 Oct 06 12:25:59.631960 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 248/484] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:59 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:25:59.679769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3c8c042b-ab80-4101-a466-20a694ed657b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.092923 Oct 06 12:25:59.680412 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 237/485] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:25:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:25:59.692000 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-98bbe2e9-efb3-4b8c-9844-0a41d0397f93 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:59.692622 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-98bbe2e9-efb3-4b8c-9844-0a41d0397f93 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:59.747256 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-98bbe2e9-efb3-4b8c-9844-0a41d0397f93 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:59.755852 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-98bbe2e9-efb3-4b8c-9844-0a41d0397f93 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1093 microversion: 2.1 time: 0.067827 Oct 06 12:25:59.767858 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 249/486] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:59 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:25:59.863890 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f984f0a7-6984-461f-8491-6c1a2af17e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:25:59.864831 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f984f0a7-6984-461f-8491-6c1a2af17e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:25:59.871826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f984f0a7-6984-461f-8491-6c1a2af17e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:59.872424 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f984f0a7-6984-461f-8491-6c1a2af17e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:59.872868 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f984f0a7-6984-461f-8491-6c1a2af17e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:59.873881 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f984f0a7-6984-461f-8491-6c1a2af17e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:59.874575 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f984f0a7-6984-461f-8491-6c1a2af17e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:59.875261 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f984f0a7-6984-461f-8491-6c1a2af17e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:59.899909 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=100 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:59.915965 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f984f0a7-6984-461f-8491-6c1a2af17e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:25:59.918412 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f984f0a7-6984-461f-8491-6c1a2af17e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:25:59.918999 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f984f0a7-6984-461f-8491-6c1a2af17e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:25:59.919630 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-f984f0a7-6984-461f-8491-6c1a2af17e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:25:59.972418 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f984f0a7-6984-461f-8491-6c1a2af17e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:25:59.980692 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f984f0a7-6984-461f-8491-6c1a2af17e30 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.121490 Oct 06 12:25:59.981301 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 238/487] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:25:59 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:00.401838 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c232065f-4309-4cd0-94f3-d5efdfb4ea9c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:00.402560 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c232065f-4309-4cd0-94f3-d5efdfb4ea9c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:00.409341 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c232065f-4309-4cd0-94f3-d5efdfb4ea9c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:00.409873 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c232065f-4309-4cd0-94f3-d5efdfb4ea9c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:00.410303 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c232065f-4309-4cd0-94f3-d5efdfb4ea9c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:00.411181 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c232065f-4309-4cd0-94f3-d5efdfb4ea9c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:00.411886 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c232065f-4309-4cd0-94f3-d5efdfb4ea9c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:00.412702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c232065f-4309-4cd0-94f3-d5efdfb4ea9c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:00.548950 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c232065f-4309-4cd0-94f3-d5efdfb4ea9c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:00.556833 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c232065f-4309-4cd0-94f3-d5efdfb4ea9c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.158845 Oct 06 12:26:00.557419 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 250/488] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:00 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:00.654354 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8d8174fa-ab14-49c6-8614-7dc6c6725002 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:00.654951 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8d8174fa-ab14-49c6-8614-7dc6c6725002 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:00.661836 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8d8174fa-ab14-49c6-8614-7dc6c6725002 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:00.662380 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8d8174fa-ab14-49c6-8614-7dc6c6725002 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:00.662907 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8d8174fa-ab14-49c6-8614-7dc6c6725002 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:00.663789 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8d8174fa-ab14-49c6-8614-7dc6c6725002 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:00.664331 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8d8174fa-ab14-49c6-8614-7dc6c6725002 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:00.664801 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8d8174fa-ab14-49c6-8614-7dc6c6725002 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:00.782117 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ebba2b7a-dce0-4e5e-a485-50bb5f40e6fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:00.782735 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ebba2b7a-dce0-4e5e-a485-50bb5f40e6fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:00.788431 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ebba2b7a-dce0-4e5e-a485-50bb5f40e6fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:00.788954 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ebba2b7a-dce0-4e5e-a485-50bb5f40e6fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:00.789394 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ebba2b7a-dce0-4e5e-a485-50bb5f40e6fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:00.790090 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ebba2b7a-dce0-4e5e-a485-50bb5f40e6fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:00.790550 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ebba2b7a-dce0-4e5e-a485-50bb5f40e6fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:00.791218 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ebba2b7a-dce0-4e5e-a485-50bb5f40e6fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:00.798116 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8d8174fa-ab14-49c6-8614-7dc6c6725002 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:00.810441 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8d8174fa-ab14-49c6-8614-7dc6c6725002 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.159887 Oct 06 12:26:00.812261 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 239/489] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:00 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:00.859911 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ebba2b7a-dce0-4e5e-a485-50bb5f40e6fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:00.869601 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ebba2b7a-dce0-4e5e-a485-50bb5f40e6fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1143 microversion: 2.1 time: 0.091739 Oct 06 12:26:00.870477 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 251/490] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:00 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1143 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:01.010038 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d747c57e-afe8-4f38-85dd-c1eb35e0159f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:01.010849 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d747c57e-afe8-4f38-85dd-c1eb35e0159f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:01.017358 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d747c57e-afe8-4f38-85dd-c1eb35e0159f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:01.017844 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d747c57e-afe8-4f38-85dd-c1eb35e0159f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:01.018296 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d747c57e-afe8-4f38-85dd-c1eb35e0159f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:01.018993 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d747c57e-afe8-4f38-85dd-c1eb35e0159f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:01.019446 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d747c57e-afe8-4f38-85dd-c1eb35e0159f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:01.019893 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d747c57e-afe8-4f38-85dd-c1eb35e0159f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:01.052985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d747c57e-afe8-4f38-85dd-c1eb35e0159f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:01.053464 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d747c57e-afe8-4f38-85dd-c1eb35e0159f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:01.053887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d747c57e-afe8-4f38-85dd-c1eb35e0159f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:01.054341 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-d747c57e-afe8-4f38-85dd-c1eb35e0159f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:26:01.095572 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d747c57e-afe8-4f38-85dd-c1eb35e0159f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:01.104887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d747c57e-afe8-4f38-85dd-c1eb35e0159f tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.099802 Oct 06 12:26:01.105692 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 240/491] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:01 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:01.580524 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e28b1112-b2fc-4dbe-b570-85af3da20aec tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:01.581125 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e28b1112-b2fc-4dbe-b570-85af3da20aec tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:01.587483 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e28b1112-b2fc-4dbe-b570-85af3da20aec tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:01.587996 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e28b1112-b2fc-4dbe-b570-85af3da20aec tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:01.588433 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e28b1112-b2fc-4dbe-b570-85af3da20aec tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:01.589116 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e28b1112-b2fc-4dbe-b570-85af3da20aec tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:01.589626 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e28b1112-b2fc-4dbe-b570-85af3da20aec tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:01.589999 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e28b1112-b2fc-4dbe-b570-85af3da20aec tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:01.593939 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=100 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:01.720352 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e28b1112-b2fc-4dbe-b570-85af3da20aec tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:01.727966 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e28b1112-b2fc-4dbe-b570-85af3da20aec tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.151348 Oct 06 12:26:01.728544 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 252/492] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:01 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:01.835392 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ea092312-b06a-4849-b5fa-e05455d4159f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:01.836059 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ea092312-b06a-4849-b5fa-e05455d4159f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:01.842140 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ea092312-b06a-4849-b5fa-e05455d4159f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:01.842565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ea092312-b06a-4849-b5fa-e05455d4159f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:01.842994 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ea092312-b06a-4849-b5fa-e05455d4159f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:01.843723 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ea092312-b06a-4849-b5fa-e05455d4159f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:01.844171 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ea092312-b06a-4849-b5fa-e05455d4159f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:01.844588 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ea092312-b06a-4849-b5fa-e05455d4159f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:01.893995 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a417bff3-4518-4c51-a2e6-44bf5741810c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:01.894608 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a417bff3-4518-4c51-a2e6-44bf5741810c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:01.901478 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a417bff3-4518-4c51-a2e6-44bf5741810c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:01.901977 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a417bff3-4518-4c51-a2e6-44bf5741810c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:01.902410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a417bff3-4518-4c51-a2e6-44bf5741810c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:01.911564 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a417bff3-4518-4c51-a2e6-44bf5741810c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:01.911564 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a417bff3-4518-4c51-a2e6-44bf5741810c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:01.911564 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a417bff3-4518-4c51-a2e6-44bf5741810c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:01.990764 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a417bff3-4518-4c51-a2e6-44bf5741810c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:01.998710 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a417bff3-4518-4c51-a2e6-44bf5741810c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1143 microversion: 2.1 time: 0.109458 Oct 06 12:26:01.999752 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 253/493] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:01 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1143 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:02.020991 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ea092312-b06a-4849-b5fa-e05455d4159f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:02.029127 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ea092312-b06a-4849-b5fa-e05455d4159f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.197518 Oct 06 12:26:02.029707 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 241/494] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:01 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:02.131755 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2c4a72b1-730a-40a2-a8f6-a85d4d9eb6ce tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:02.132936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2c4a72b1-730a-40a2-a8f6-a85d4d9eb6ce tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:02.140048 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2c4a72b1-730a-40a2-a8f6-a85d4d9eb6ce tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:02.140541 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2c4a72b1-730a-40a2-a8f6-a85d4d9eb6ce tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:02.140975 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2c4a72b1-730a-40a2-a8f6-a85d4d9eb6ce tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:02.141741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2c4a72b1-730a-40a2-a8f6-a85d4d9eb6ce tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:02.142240 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2c4a72b1-730a-40a2-a8f6-a85d4d9eb6ce tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:02.142663 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2c4a72b1-730a-40a2-a8f6-a85d4d9eb6ce tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:02.192999 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2c4a72b1-730a-40a2-a8f6-a85d4d9eb6ce tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:02.194309 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2c4a72b1-730a-40a2-a8f6-a85d4d9eb6ce tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:02.194970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2c4a72b1-730a-40a2-a8f6-a85d4d9eb6ce tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:02.195686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-2c4a72b1-730a-40a2-a8f6-a85d4d9eb6ce tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:26:02.238065 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2c4a72b1-730a-40a2-a8f6-a85d4d9eb6ce tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:02.257806 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2c4a72b1-730a-40a2-a8f6-a85d4d9eb6ce tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.132449 Oct 06 12:26:02.258629 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 254/495] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:02 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:02.750247 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9cd188bc-bf43-4a22-be36-d46d55785b20 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:02.750886 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9cd188bc-bf43-4a22-be36-d46d55785b20 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:02.757019 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9cd188bc-bf43-4a22-be36-d46d55785b20 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:02.757509 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9cd188bc-bf43-4a22-be36-d46d55785b20 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:02.757945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9cd188bc-bf43-4a22-be36-d46d55785b20 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:02.758639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9cd188bc-bf43-4a22-be36-d46d55785b20 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:02.759087 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9cd188bc-bf43-4a22-be36-d46d55785b20 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:02.759525 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9cd188bc-bf43-4a22-be36-d46d55785b20 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:02.888622 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9cd188bc-bf43-4a22-be36-d46d55785b20 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:02.897218 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9cd188bc-bf43-4a22-be36-d46d55785b20 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.150762 Oct 06 12:26:02.898078 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 242/496] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:02 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:03.021666 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4f7d50d4-8fba-4878-81a2-3b7be3af9dc8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:03.022234 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-4f7d50d4-8fba-4878-81a2-3b7be3af9dc8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:03.028714 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4f7d50d4-8fba-4878-81a2-3b7be3af9dc8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:03.029218 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4f7d50d4-8fba-4878-81a2-3b7be3af9dc8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:03.029660 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4f7d50d4-8fba-4878-81a2-3b7be3af9dc8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:03.030635 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4f7d50d4-8fba-4878-81a2-3b7be3af9dc8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:03.031123 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4f7d50d4-8fba-4878-81a2-3b7be3af9dc8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:03.031570 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4f7d50d4-8fba-4878-81a2-3b7be3af9dc8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:03.053504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-09f817c3-45b2-461a-8e04-c496be1c219e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:03.054320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-09f817c3-45b2-461a-8e04-c496be1c219e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:03.060684 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09f817c3-45b2-461a-8e04-c496be1c219e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:03.061803 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09f817c3-45b2-461a-8e04-c496be1c219e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:03.062312 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09f817c3-45b2-461a-8e04-c496be1c219e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:03.063473 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09f817c3-45b2-461a-8e04-c496be1c219e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:03.064617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09f817c3-45b2-461a-8e04-c496be1c219e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:03.065264 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09f817c3-45b2-461a-8e04-c496be1c219e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:03.097635 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4f7d50d4-8fba-4878-81a2-3b7be3af9dc8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:03.112490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4f7d50d4-8fba-4878-81a2-3b7be3af9dc8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1143 microversion: 2.1 time: 0.095203 Oct 06 12:26:03.113458 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 255/497] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:03 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1143 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:03.217324 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-09f817c3-45b2-461a-8e04-c496be1c219e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:03.227342 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-09f817c3-45b2-461a-8e04-c496be1c219e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.178284 Oct 06 12:26:03.227958 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 243/498] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:03 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:03.281503 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4d498467-717a-47b1-b3cf-b653f6419ff5 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:03.282218 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-4d498467-717a-47b1-b3cf-b653f6419ff5 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:03.292730 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d498467-717a-47b1-b3cf-b653f6419ff5 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:03.293317 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d498467-717a-47b1-b3cf-b653f6419ff5 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:03.293833 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d498467-717a-47b1-b3cf-b653f6419ff5 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:03.294648 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d498467-717a-47b1-b3cf-b653f6419ff5 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:03.295177 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d498467-717a-47b1-b3cf-b653f6419ff5 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:03.295711 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d498467-717a-47b1-b3cf-b653f6419ff5 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:03.327369 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d498467-717a-47b1-b3cf-b653f6419ff5 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:03.328172 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d498467-717a-47b1-b3cf-b653f6419ff5 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:03.328601 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d498467-717a-47b1-b3cf-b653f6419ff5 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:03.329055 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-4d498467-717a-47b1-b3cf-b653f6419ff5 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:26:03.377939 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4d498467-717a-47b1-b3cf-b653f6419ff5 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:03.385834 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4d498467-717a-47b1-b3cf-b653f6419ff5 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.108650 Oct 06 12:26:03.386413 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 256/499] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:03 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:03.641396 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-79521a6f-c3b9-4cd6-9f8d-e0db3e825835 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:03.641895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-79521a6f-c3b9-4cd6-9f8d-e0db3e825835 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:03.648557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-79521a6f-c3b9-4cd6-9f8d-e0db3e825835 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:03.649047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-79521a6f-c3b9-4cd6-9f8d-e0db3e825835 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:03.649492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-79521a6f-c3b9-4cd6-9f8d-e0db3e825835 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:03.650181 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-79521a6f-c3b9-4cd6-9f8d-e0db3e825835 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:03.650636 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-79521a6f-c3b9-4cd6-9f8d-e0db3e825835 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:03.651063 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-79521a6f-c3b9-4cd6-9f8d-e0db3e825835 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:03.676132 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-79521a6f-c3b9-4cd6-9f8d-e0db3e825835 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/ips" status: 200 len: 146 microversion: 2.1 time: 0.038618 Oct 06 12:26:03.680545 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 244/500] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 12:26:03 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:26:03.921031 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3ebc8d45-e2ef-4eef-b430-340b012309ae tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:03.921559 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3ebc8d45-e2ef-4eef-b430-340b012309ae tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:03.928190 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3ebc8d45-e2ef-4eef-b430-340b012309ae tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:03.928723 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3ebc8d45-e2ef-4eef-b430-340b012309ae tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:03.929159 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3ebc8d45-e2ef-4eef-b430-340b012309ae tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:03.929846 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3ebc8d45-e2ef-4eef-b430-340b012309ae tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:03.930430 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3ebc8d45-e2ef-4eef-b430-340b012309ae tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:03.931110 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3ebc8d45-e2ef-4eef-b430-340b012309ae tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:04.062128 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3ebc8d45-e2ef-4eef-b430-340b012309ae tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:04.070343 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3ebc8d45-e2ef-4eef-b430-340b012309ae tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.153345 Oct 06 12:26:04.070961 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 257/501] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:03 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:04.136642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8c5f6c2e-35d8-40ed-804c-b14a49b06e80 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:04.137259 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8c5f6c2e-35d8-40ed-804c-b14a49b06e80 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:04.143180 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c5f6c2e-35d8-40ed-804c-b14a49b06e80 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:04.143702 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c5f6c2e-35d8-40ed-804c-b14a49b06e80 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:04.144146 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c5f6c2e-35d8-40ed-804c-b14a49b06e80 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:04.144830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c5f6c2e-35d8-40ed-804c-b14a49b06e80 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:04.145278 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c5f6c2e-35d8-40ed-804c-b14a49b06e80 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:04.145733 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c5f6c2e-35d8-40ed-804c-b14a49b06e80 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:04.207438 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8c5f6c2e-35d8-40ed-804c-b14a49b06e80 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:04.215170 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8c5f6c2e-35d8-40ed-804c-b14a49b06e80 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1143 microversion: 2.1 time: 0.082424 Oct 06 12:26:04.215759 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 245/502] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:04 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:04.250082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b75e3305-d64d-4de8-9cef-66d91e3be9e4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:04.250699 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b75e3305-d64d-4de8-9cef-66d91e3be9e4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:04.257135 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b75e3305-d64d-4de8-9cef-66d91e3be9e4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:04.257620 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b75e3305-d64d-4de8-9cef-66d91e3be9e4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:04.258053 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b75e3305-d64d-4de8-9cef-66d91e3be9e4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:04.258744 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b75e3305-d64d-4de8-9cef-66d91e3be9e4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:04.259198 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b75e3305-d64d-4de8-9cef-66d91e3be9e4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:04.259671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b75e3305-d64d-4de8-9cef-66d91e3be9e4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:04.386628 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b75e3305-d64d-4de8-9cef-66d91e3be9e4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:04.394881 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b75e3305-d64d-4de8-9cef-66d91e3be9e4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.148601 Oct 06 12:26:04.395448 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 258/503] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:04 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:04.410287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-699401ee-c4bc-4e66-8dcd-56b09a386d10 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:04.410907 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-699401ee-c4bc-4e66-8dcd-56b09a386d10 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:04.417426 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-699401ee-c4bc-4e66-8dcd-56b09a386d10 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:04.417916 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-699401ee-c4bc-4e66-8dcd-56b09a386d10 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:04.418348 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-699401ee-c4bc-4e66-8dcd-56b09a386d10 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:04.419033 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-699401ee-c4bc-4e66-8dcd-56b09a386d10 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:04.419575 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-699401ee-c4bc-4e66-8dcd-56b09a386d10 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:04.419917 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-699401ee-c4bc-4e66-8dcd-56b09a386d10 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:04.451307 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-699401ee-c4bc-4e66-8dcd-56b09a386d10 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:04.451913 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-699401ee-c4bc-4e66-8dcd-56b09a386d10 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:04.452345 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-699401ee-c4bc-4e66-8dcd-56b09a386d10 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:04.452779 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-699401ee-c4bc-4e66-8dcd-56b09a386d10 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:26:04.497593 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-699401ee-c4bc-4e66-8dcd-56b09a386d10 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:04.505594 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-699401ee-c4bc-4e66-8dcd-56b09a386d10 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.099333 Oct 06 12:26:04.506383 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 246/504] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:04 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:05.093030 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-fc03ee22-8854-4fe0-a4a1-8740a3451051 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:05.093566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-fc03ee22-8854-4fe0-a4a1-8740a3451051 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:05.100583 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fc03ee22-8854-4fe0-a4a1-8740a3451051 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:05.101069 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fc03ee22-8854-4fe0-a4a1-8740a3451051 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:05.101504 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fc03ee22-8854-4fe0-a4a1-8740a3451051 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:05.102193 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fc03ee22-8854-4fe0-a4a1-8740a3451051 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:05.102648 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fc03ee22-8854-4fe0-a4a1-8740a3451051 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:05.103071 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fc03ee22-8854-4fe0-a4a1-8740a3451051 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:05.229844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-fc03ee22-8854-4fe0-a4a1-8740a3451051 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:05.236856 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-fce19f88-b9ee-4d43-925b-60ccc405dcba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:05.237473 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-fce19f88-b9ee-4d43-925b-60ccc405dcba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:05.237584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-fc03ee22-8854-4fe0-a4a1-8740a3451051 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.148467 Oct 06 12:26:05.238146 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 259/505] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:05 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:05.243455 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fce19f88-b9ee-4d43-925b-60ccc405dcba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:05.243984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fce19f88-b9ee-4d43-925b-60ccc405dcba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:05.244425 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fce19f88-b9ee-4d43-925b-60ccc405dcba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:05.245124 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fce19f88-b9ee-4d43-925b-60ccc405dcba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:05.246020 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fce19f88-b9ee-4d43-925b-60ccc405dcba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:05.246020 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fce19f88-b9ee-4d43-925b-60ccc405dcba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:05.305713 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fce19f88-b9ee-4d43-925b-60ccc405dcba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:05.313282 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-fce19f88-b9ee-4d43-925b-60ccc405dcba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1143 microversion: 2.1 time: 0.080245 Oct 06 12:26:05.313848 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 247/506] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:05 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:05.417935 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2bcd5550-ba8b-4ffd-af62-661032fb63e6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:05.418545 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2bcd5550-ba8b-4ffd-af62-661032fb63e6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:05.424461 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2bcd5550-ba8b-4ffd-af62-661032fb63e6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:05.424946 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2bcd5550-ba8b-4ffd-af62-661032fb63e6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:05.425381 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2bcd5550-ba8b-4ffd-af62-661032fb63e6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:05.426068 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2bcd5550-ba8b-4ffd-af62-661032fb63e6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:05.426521 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2bcd5550-ba8b-4ffd-af62-661032fb63e6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:05.426941 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2bcd5550-ba8b-4ffd-af62-661032fb63e6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:05.528746 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-737f9e0b-8c38-4e81-ac9f-acbc372952ff tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:05.529345 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-737f9e0b-8c38-4e81-ac9f-acbc372952ff tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:05.536011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-737f9e0b-8c38-4e81-ac9f-acbc372952ff tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:05.536489 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-737f9e0b-8c38-4e81-ac9f-acbc372952ff tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:05.536918 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-737f9e0b-8c38-4e81-ac9f-acbc372952ff tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:05.537592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-737f9e0b-8c38-4e81-ac9f-acbc372952ff tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:05.538036 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-737f9e0b-8c38-4e81-ac9f-acbc372952ff tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:05.538451 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-737f9e0b-8c38-4e81-ac9f-acbc372952ff tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:05.558233 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2bcd5550-ba8b-4ffd-af62-661032fb63e6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:05.566482 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2bcd5550-ba8b-4ffd-af62-661032fb63e6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.152349 Oct 06 12:26:05.567061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 260/507] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:05 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:05.570035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-737f9e0b-8c38-4e81-ac9f-acbc372952ff tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:05.570526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-737f9e0b-8c38-4e81-ac9f-acbc372952ff tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:05.570955 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-737f9e0b-8c38-4e81-ac9f-acbc372952ff tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:05.571395 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-737f9e0b-8c38-4e81-ac9f-acbc372952ff tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:26:05.610799 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-737f9e0b-8c38-4e81-ac9f-acbc372952ff tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:05.618523 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-737f9e0b-8c38-4e81-ac9f-acbc372952ff tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.093734 Oct 06 12:26:05.619083 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 248/508] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:05 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:06.261832 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-02990619-fafe-4636-84d0-bcdbce121e8e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:06.262504 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-02990619-fafe-4636-84d0-bcdbce121e8e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:06.269613 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-02990619-fafe-4636-84d0-bcdbce121e8e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:06.270104 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-02990619-fafe-4636-84d0-bcdbce121e8e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:06.270577 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-02990619-fafe-4636-84d0-bcdbce121e8e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:06.271285 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-02990619-fafe-4636-84d0-bcdbce121e8e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:06.271775 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-02990619-fafe-4636-84d0-bcdbce121e8e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:06.272354 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-02990619-fafe-4636-84d0-bcdbce121e8e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:06.336480 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c55ccf66-c8c9-4fb0-9e16-0ba837aae31c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:06.337000 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c55ccf66-c8c9-4fb0-9e16-0ba837aae31c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:06.342690 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c55ccf66-c8c9-4fb0-9e16-0ba837aae31c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:06.343172 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c55ccf66-c8c9-4fb0-9e16-0ba837aae31c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:06.343652 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c55ccf66-c8c9-4fb0-9e16-0ba837aae31c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:06.344338 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c55ccf66-c8c9-4fb0-9e16-0ba837aae31c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:06.344781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c55ccf66-c8c9-4fb0-9e16-0ba837aae31c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:06.345198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c55ccf66-c8c9-4fb0-9e16-0ba837aae31c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:06.415324 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c55ccf66-c8c9-4fb0-9e16-0ba837aae31c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:06.422876 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c55ccf66-c8c9-4fb0-9e16-0ba837aae31c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1143 microversion: 2.1 time: 0.090240 Oct 06 12:26:06.423665 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 249/509] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:06 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:06.427002 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-02990619-fafe-4636-84d0-bcdbce121e8e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:06.434783 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-02990619-fafe-4636-84d0-bcdbce121e8e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.177043 Oct 06 12:26:06.435427 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 261/510] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:06 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:06.589381 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d56ae3f1-439a-466d-b79f-979bd2386a80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:06.589913 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d56ae3f1-439a-466d-b79f-979bd2386a80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:06.595845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d56ae3f1-439a-466d-b79f-979bd2386a80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:06.596328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d56ae3f1-439a-466d-b79f-979bd2386a80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:06.596763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d56ae3f1-439a-466d-b79f-979bd2386a80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:06.597647 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d56ae3f1-439a-466d-b79f-979bd2386a80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:06.597932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d56ae3f1-439a-466d-b79f-979bd2386a80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:06.598322 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d56ae3f1-439a-466d-b79f-979bd2386a80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:06.641946 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-eab78750-7b09-41d4-a9d1-baaa843abd13 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:06.642562 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-eab78750-7b09-41d4-a9d1-baaa843abd13 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:06.649012 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eab78750-7b09-41d4-a9d1-baaa843abd13 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:06.649495 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eab78750-7b09-41d4-a9d1-baaa843abd13 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:06.649927 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eab78750-7b09-41d4-a9d1-baaa843abd13 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:06.650621 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eab78750-7b09-41d4-a9d1-baaa843abd13 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:06.651078 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eab78750-7b09-41d4-a9d1-baaa843abd13 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:06.651499 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eab78750-7b09-41d4-a9d1-baaa843abd13 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:06.681801 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eab78750-7b09-41d4-a9d1-baaa843abd13 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:06.682282 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eab78750-7b09-41d4-a9d1-baaa843abd13 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:06.682706 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eab78750-7b09-41d4-a9d1-baaa843abd13 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:06.683141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-eab78750-7b09-41d4-a9d1-baaa843abd13 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:26:06.730102 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-eab78750-7b09-41d4-a9d1-baaa843abd13 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:06.738188 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-eab78750-7b09-41d4-a9d1-baaa843abd13 tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.100168 Oct 06 12:26:06.738755 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 262/511] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:06 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:06.751892 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d56ae3f1-439a-466d-b79f-979bd2386a80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:06.760838 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d56ae3f1-439a-466d-b79f-979bd2386a80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.175244 Oct 06 12:26:06.761606 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 250/512] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:06 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:06.821736 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b07bd658-ad03-437d-bf38-c73d98a322e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2946d72-c741-4e47-af0b-d2e50d835a42"}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:26:06.824153 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b07bd658-ad03-437d-bf38-c73d98a322e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:06.830070 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b07bd658-ad03-437d-bf38-c73d98a322e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:06.830559 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b07bd658-ad03-437d-bf38-c73d98a322e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:06.830984 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b07bd658-ad03-437d-bf38-c73d98a322e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:06.831730 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b07bd658-ad03-437d-bf38-c73d98a322e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:06.832183 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b07bd658-ad03-437d-bf38-c73d98a322e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:06.832601 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b07bd658-ad03-437d-bf38-c73d98a322e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:07.446238 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d1884f5d-a184-448c-b25e-9a56226b31bd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:07.446859 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d1884f5d-a184-448c-b25e-9a56226b31bd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:07.452763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d1884f5d-a184-448c-b25e-9a56226b31bd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:07.453249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d1884f5d-a184-448c-b25e-9a56226b31bd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:07.453675 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d1884f5d-a184-448c-b25e-9a56226b31bd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:07.454349 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d1884f5d-a184-448c-b25e-9a56226b31bd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:07.454795 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d1884f5d-a184-448c-b25e-9a56226b31bd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:07.455252 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d1884f5d-a184-448c-b25e-9a56226b31bd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:07.514992 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d1884f5d-a184-448c-b25e-9a56226b31bd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:07.522499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d1884f5d-a184-448c-b25e-9a56226b31bd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1143 microversion: 2.1 time: 0.080166 Oct 06 12:26:07.523051 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 251/513] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:07 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:07.527333 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e28e9d39-9322-48b8-848a-adf418412e13 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:07.527945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e28e9d39-9322-48b8-848a-adf418412e13 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:07.533537 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e28e9d39-9322-48b8-848a-adf418412e13 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:07.534011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e28e9d39-9322-48b8-848a-adf418412e13 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:07.534438 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e28e9d39-9322-48b8-848a-adf418412e13 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:07.535113 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e28e9d39-9322-48b8-848a-adf418412e13 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:07.535593 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e28e9d39-9322-48b8-848a-adf418412e13 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:07.536001 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e28e9d39-9322-48b8-848a-adf418412e13 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:07.662578 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e28e9d39-9322-48b8-848a-adf418412e13 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:07.670151 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e28e9d39-9322-48b8-848a-adf418412e13 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.146143 Oct 06 12:26:07.670709 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 252/514] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:07 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:07.783804 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ebbb1835-6314-467e-91a5-a69bc9e57531 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:07.784330 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ebbb1835-6314-467e-91a5-a69bc9e57531 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:07.790184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ebbb1835-6314-467e-91a5-a69bc9e57531 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:07.790663 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ebbb1835-6314-467e-91a5-a69bc9e57531 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:07.791097 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ebbb1835-6314-467e-91a5-a69bc9e57531 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:07.791811 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ebbb1835-6314-467e-91a5-a69bc9e57531 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:07.792259 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ebbb1835-6314-467e-91a5-a69bc9e57531 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:07.792677 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ebbb1835-6314-467e-91a5-a69bc9e57531 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:07.917191 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ebbb1835-6314-467e-91a5-a69bc9e57531 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:07.925251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ebbb1835-6314-467e-91a5-a69bc9e57531 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.145625 Oct 06 12:26:07.925807 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 253/515] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:07 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:07.930227 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a287bbea-70db-42d6-953f-460d6375695e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:07.930823 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a287bbea-70db-42d6-953f-460d6375695e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:07.936296 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a287bbea-70db-42d6-953f-460d6375695e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:07.936775 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a287bbea-70db-42d6-953f-460d6375695e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:07.937206 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a287bbea-70db-42d6-953f-460d6375695e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:07.937886 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a287bbea-70db-42d6-953f-460d6375695e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:07.938336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a287bbea-70db-42d6-953f-460d6375695e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:07.938759 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a287bbea-70db-42d6-953f-460d6375695e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:07.942712 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=100 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:07.968822 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a287bbea-70db-42d6-953f-460d6375695e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:07.969304 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a287bbea-70db-42d6-953f-460d6375695e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:07.969743 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a287bbea-70db-42d6-953f-460d6375695e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:07.970186 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-a287bbea-70db-42d6-953f-460d6375695e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lazy-loading 'fault' on Instance uuid 0d8e72d3-918b-4046-897d-e7c3f5a5913c {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:26:08.009618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a287bbea-70db-42d6-953f-460d6375695e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d817e129beb41168af70c3ada99aeda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1ba5fc96344cebdb16d6a3e50ab8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:08.017169 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a287bbea-70db-42d6-953f-460d6375695e tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 200 len: 1304 microversion: 2.1 time: 0.090426 Oct 06 12:26:08.017729 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 254/516] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:07 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:08.545294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-cfe74904-59cd-42bb-ad42-869d20c07fd5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:08.545934 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-cfe74904-59cd-42bb-ad42-869d20c07fd5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:08.551811 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cfe74904-59cd-42bb-ad42-869d20c07fd5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:08.552294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cfe74904-59cd-42bb-ad42-869d20c07fd5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:08.552727 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cfe74904-59cd-42bb-ad42-869d20c07fd5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:08.553413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cfe74904-59cd-42bb-ad42-869d20c07fd5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:08.553857 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cfe74904-59cd-42bb-ad42-869d20c07fd5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:08.554279 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cfe74904-59cd-42bb-ad42-869d20c07fd5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:08.619901 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-cfe74904-59cd-42bb-ad42-869d20c07fd5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:08.631060 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-cfe74904-59cd-42bb-ad42-869d20c07fd5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1143 microversion: 2.1 time: 0.089615 Oct 06 12:26:08.637521 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 255/517] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:08 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1143 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:08.693853 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ec841c74-4a07-43a4-8ec3-efdea05dba02 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:08.694555 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ec841c74-4a07-43a4-8ec3-efdea05dba02 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:08.701193 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec841c74-4a07-43a4-8ec3-efdea05dba02 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:08.701688 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec841c74-4a07-43a4-8ec3-efdea05dba02 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:08.702126 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec841c74-4a07-43a4-8ec3-efdea05dba02 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:08.708118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec841c74-4a07-43a4-8ec3-efdea05dba02 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:08.708600 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec841c74-4a07-43a4-8ec3-efdea05dba02 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:08.709037 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec841c74-4a07-43a4-8ec3-efdea05dba02 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:08.975525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b07bd658-ad03-437d-bf38-c73d98a322e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "POST /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.157373 Oct 06 12:26:08.980040 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 263/518] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 12:26:06 2022] POST /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/os-volume_attachments => generated 194 bytes in 2163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:26:08.998275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-405c6b57-6479-4c16-81ca-7615e5d5be7a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:09.000748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-405c6b57-6479-4c16-81ca-7615e5d5be7a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:09.012811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-405c6b57-6479-4c16-81ca-7615e5d5be7a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:09.014266 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-405c6b57-6479-4c16-81ca-7615e5d5be7a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:09.014705 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-405c6b57-6479-4c16-81ca-7615e5d5be7a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:09.015769 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-405c6b57-6479-4c16-81ca-7615e5d5be7a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:09.016761 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-405c6b57-6479-4c16-81ca-7615e5d5be7a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:09.017353 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-405c6b57-6479-4c16-81ca-7615e5d5be7a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:09.020731 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ec841c74-4a07-43a4-8ec3-efdea05dba02 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:09.030415 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ec841c74-4a07-43a4-8ec3-efdea05dba02 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.340870 Oct 06 12:26:09.038651 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 256/519] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:08 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:09.044095 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f637024b-4d57-44ba-b614-9bb4b6e90fca tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:09.051167 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f637024b-4d57-44ba-b614-9bb4b6e90fca tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] [instance: 0d8e72d3-918b-4046-897d-e7c3f5a5913c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:09.063003 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f637024b-4d57-44ba-b614-9bb4b6e90fca tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:09.064006 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f637024b-4d57-44ba-b614-9bb4b6e90fca tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:09.065241 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f637024b-4d57-44ba-b614-9bb4b6e90fca tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:09.066454 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f637024b-4d57-44ba-b614-9bb4b6e90fca tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:09.067123 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f637024b-4d57-44ba-b614-9bb4b6e90fca tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:09.068482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f637024b-4d57-44ba-b614-9bb4b6e90fca tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:09.098723 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-f637024b-4d57-44ba-b614-9bb4b6e90fca tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] HTTP exception thrown: Instance 0d8e72d3-918b-4046-897d-e7c3f5a5913c could not be found. Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f637024b-4d57-44ba-b614-9bb4b6e90fca tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Request method failure captured: Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c HTTP/1.1 Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPskD7nB67jvgIhLyVbHlTUNrp05JdKAhoXfzKFI_6vFcAc_N-M-Q_3F1aNeDtZVa2hSFzdh-mS7PEKT1ccykNbEtEawGpW-I-Jw6p9w5H_IaDi_wTF1v5yLD1ZfRKUFgWELfrW_Ib-2FldxPSn2ehrj20r0204fqFF17mRVn0IfUphE Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 53e1ba5fc96344cebdb16d6a3e50ab8f Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-VolumesActionsTest-934281125 Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:26:09.100741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:26:09.102118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53e1ba5fc96344cebdb16d6a3e50ab8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53e1ba5fc96344cebdb16d6a3e50ab8f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53e1ba5fc96344cebdb16d6a3e50ab8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53e1ba5fc96344cebdb16d6a3e50ab8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:26:09.102118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-VolumesActionsTest-934281125 Oct 06 12:26:09.102118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 53e1ba5fc96344cebdb16d6a3e50ab8f Oct 06 12:26:09.102118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-VolumesActionsTest-934281125 Oct 06 12:26:09.102118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-VolumesActionsTest-934281125-project Oct 06 12:26:09.102118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:26:09.102118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:26:09.102118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 8d817e129beb41168af70c3ada99aeda Oct 06 12:26:09.102118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-VolumesActionsTest-934281125-project Oct 06 12:26:09.102118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:26:09.102118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 0d8e72d3-918b-4046-897d-e7c3f5a5913c could not be found. Oct 06 12:26:09.102118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '0d8e72d3-918b-4046-897d-e7c3f5a5913c'} Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d8e72d3-918b-4046-897d-e7c3f5a5913c could not be found. Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:26:09.102936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d8e72d3-918b-4046-897d-e7c3f5a5913c could not be found. Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d8e72d3-918b-4046-897d-e7c3f5a5913c could not be found. Oct 06 12:26:09.104187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:26:09.106211 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f637024b-4d57-44ba-b614-9bb4b6e90fca tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] Returning 404 to user: Instance 0d8e72d3-918b-4046-897d-e7c3f5a5913c could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:26:09.107054 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f637024b-4d57-44ba-b614-9bb4b6e90fca tempest-VolumesActionsTest-934281125 tempest-VolumesActionsTest-934281125-project] 10.222.0.33 "GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c" status: 404 len: 111 microversion: 2.1 time: 0.066793 Oct 06 12:26:09.112197 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 257/520] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:09 2022] GET /compute/v2.1/servers/0d8e72d3-918b-4046-897d-e7c3f5a5913c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:26:09.261365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-405c6b57-6479-4c16-81ca-7615e5d5be7a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:09.269400 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-405c6b57-6479-4c16-81ca-7615e5d5be7a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.287671 Oct 06 12:26:09.269977 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 264/521] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:08 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:09.545374 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-45a631c1-7abc-4641-a290-20ef5d45ce70 req-08f86d41-a031-4af5-81dc-a81b5e8ea72b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb42d057-804d-4d87-953a-953bf69fe126", "tag": "9a4b9943-b074-4a4d-a9c2-a11438741a56"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:26:09.550881 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:09.551582 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=6 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:09.563039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-45a631c1-7abc-4641-a290-20ef5d45ce70 req-08f86d41-a031-4af5-81dc-a81b5e8ea72b service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:09.563665 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-45a631c1-7abc-4641-a290-20ef5d45ce70 req-08f86d41-a031-4af5-81dc-a81b5e8ea72b service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:09.564614 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-45a631c1-7abc-4641-a290-20ef5d45ce70 req-08f86d41-a031-4af5-81dc-a81b5e8ea72b service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:09.578020 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-45a631c1-7abc-4641-a290-20ef5d45ce70 req-08f86d41-a031-4af5-81dc-a81b5e8ea72b service nova] Creating event network-changed:9a4b9943-b074-4a4d-a9c2-a11438741a56 for instance eb42d057-804d-4d87-953a-953bf69fe126 on hv-cinder-85604 Oct 06 12:26:09.584097 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-45a631c1-7abc-4641-a290-20ef5d45ce70 req-08f86d41-a031-4af5-81dc-a81b5e8ea72b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041802 Oct 06 12:26:09.584964 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 258/522] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:26:09.660337 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6ce529a1-fe41-4873-b7d3-9e937f10b094 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:09.660961 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-6ce529a1-fe41-4873-b7d3-9e937f10b094 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:09.666876 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6ce529a1-fe41-4873-b7d3-9e937f10b094 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:09.667373 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6ce529a1-fe41-4873-b7d3-9e937f10b094 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:09.667860 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6ce529a1-fe41-4873-b7d3-9e937f10b094 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:09.668562 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6ce529a1-fe41-4873-b7d3-9e937f10b094 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:09.669050 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6ce529a1-fe41-4873-b7d3-9e937f10b094 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:09.669482 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6ce529a1-fe41-4873-b7d3-9e937f10b094 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:09.731920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6ce529a1-fe41-4873-b7d3-9e937f10b094 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:09.739529 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-6ce529a1-fe41-4873-b7d3-9e937f10b094 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1191 microversion: 2.1 time: 0.084608 Oct 06 12:26:09.740092 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 265/523] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:09 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:10.062775 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-cc9d9434-6a1d-45a1-b54b-09862adbead8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:10.063443 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-cc9d9434-6a1d-45a1-b54b-09862adbead8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:10.070236 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cc9d9434-6a1d-45a1-b54b-09862adbead8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:10.070712 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cc9d9434-6a1d-45a1-b54b-09862adbead8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:10.071170 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cc9d9434-6a1d-45a1-b54b-09862adbead8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:10.071899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cc9d9434-6a1d-45a1-b54b-09862adbead8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:10.072363 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cc9d9434-6a1d-45a1-b54b-09862adbead8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:10.072781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cc9d9434-6a1d-45a1-b54b-09862adbead8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:10.203596 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-cc9d9434-6a1d-45a1-b54b-09862adbead8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:10.211773 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-cc9d9434-6a1d-45a1-b54b-09862adbead8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.153579 Oct 06 12:26:10.212334 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 259/524] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:10 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:10.292143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f062e99a-3cbe-44b0-b459-076837b97286 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:10.292751 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f062e99a-3cbe-44b0-b459-076837b97286 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:10.294630 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:10.300531 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f062e99a-3cbe-44b0-b459-076837b97286 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:10.301003 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f062e99a-3cbe-44b0-b459-076837b97286 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:10.301431 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f062e99a-3cbe-44b0-b459-076837b97286 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:10.302109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f062e99a-3cbe-44b0-b459-076837b97286 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:10.302576 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f062e99a-3cbe-44b0-b459-076837b97286 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:10.302994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f062e99a-3cbe-44b0-b459-076837b97286 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:10.320917 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:10.430712 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f062e99a-3cbe-44b0-b459-076837b97286 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:10.438485 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f062e99a-3cbe-44b0-b459-076837b97286 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.150159 Oct 06 12:26:10.439077 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 266/525] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:10 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:10.763302 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-80bcb810-d3e4-45cf-bb13-2eb8902ef8c1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:10.763941 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-80bcb810-d3e4-45cf-bb13-2eb8902ef8c1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:10.765899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:10.771036 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-80bcb810-d3e4-45cf-bb13-2eb8902ef8c1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:10.771525 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-80bcb810-d3e4-45cf-bb13-2eb8902ef8c1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:10.771972 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-80bcb810-d3e4-45cf-bb13-2eb8902ef8c1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:10.772687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-80bcb810-d3e4-45cf-bb13-2eb8902ef8c1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:10.773137 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-80bcb810-d3e4-45cf-bb13-2eb8902ef8c1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:10.773557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-80bcb810-d3e4-45cf-bb13-2eb8902ef8c1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:10.833893 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-80bcb810-d3e4-45cf-bb13-2eb8902ef8c1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:10.841406 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-80bcb810-d3e4-45cf-bb13-2eb8902ef8c1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1191 microversion: 2.1 time: 0.081926 Oct 06 12:26:10.841963 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 260/526] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:10 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:11.234007 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a231e5f5-138a-4927-8026-bab51e9c46a8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:11.234644 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a231e5f5-138a-4927-8026-bab51e9c46a8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:11.240471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a231e5f5-138a-4927-8026-bab51e9c46a8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:11.240957 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a231e5f5-138a-4927-8026-bab51e9c46a8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:11.241395 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a231e5f5-138a-4927-8026-bab51e9c46a8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:11.242083 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a231e5f5-138a-4927-8026-bab51e9c46a8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:11.242541 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a231e5f5-138a-4927-8026-bab51e9c46a8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:11.242963 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a231e5f5-138a-4927-8026-bab51e9c46a8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:11.372570 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a231e5f5-138a-4927-8026-bab51e9c46a8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:11.380288 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a231e5f5-138a-4927-8026-bab51e9c46a8 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.150105 Oct 06 12:26:11.380853 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 267/527] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:11 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:11.462189 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-136dbcf4-df28-4be3-981c-479d7212fa29 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:11.462913 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-136dbcf4-df28-4be3-981c-479d7212fa29 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:11.468918 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-136dbcf4-df28-4be3-981c-479d7212fa29 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:11.469398 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-136dbcf4-df28-4be3-981c-479d7212fa29 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:11.470431 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-136dbcf4-df28-4be3-981c-479d7212fa29 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:11.471695 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-136dbcf4-df28-4be3-981c-479d7212fa29 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:11.472153 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-136dbcf4-df28-4be3-981c-479d7212fa29 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:11.472579 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-136dbcf4-df28-4be3-981c-479d7212fa29 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:11.596331 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-136dbcf4-df28-4be3-981c-479d7212fa29 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:11.603860 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-136dbcf4-df28-4be3-981c-479d7212fa29 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.145840 Oct 06 12:26:11.604420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 261/528] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:11 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:11.864473 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-446c77f8-6ad9-4fd5-a0ba-ca5b30de072d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:11.865082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-446c77f8-6ad9-4fd5-a0ba-ca5b30de072d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:11.870863 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-446c77f8-6ad9-4fd5-a0ba-ca5b30de072d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:11.871337 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-446c77f8-6ad9-4fd5-a0ba-ca5b30de072d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:11.871807 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-446c77f8-6ad9-4fd5-a0ba-ca5b30de072d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:11.872484 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-446c77f8-6ad9-4fd5-a0ba-ca5b30de072d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:11.872934 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-446c77f8-6ad9-4fd5-a0ba-ca5b30de072d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:11.873352 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-446c77f8-6ad9-4fd5-a0ba-ca5b30de072d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:11.933315 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-446c77f8-6ad9-4fd5-a0ba-ca5b30de072d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:11.941524 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-446c77f8-6ad9-4fd5-a0ba-ca5b30de072d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1191 microversion: 2.1 time: 0.080862 Oct 06 12:26:11.942081 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 268/529] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:11 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1191 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:12.402916 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7071f053-cd01-4176-abcd-0b781b230a54 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:12.403528 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7071f053-cd01-4176-abcd-0b781b230a54 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:12.410239 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7071f053-cd01-4176-abcd-0b781b230a54 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:12.410715 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7071f053-cd01-4176-abcd-0b781b230a54 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:12.411139 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7071f053-cd01-4176-abcd-0b781b230a54 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:12.411845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7071f053-cd01-4176-abcd-0b781b230a54 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:12.412290 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7071f053-cd01-4176-abcd-0b781b230a54 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:12.412707 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7071f053-cd01-4176-abcd-0b781b230a54 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:12.539617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7071f053-cd01-4176-abcd-0b781b230a54 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:12.547026 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7071f053-cd01-4176-abcd-0b781b230a54 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.147989 Oct 06 12:26:12.547606 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 262/530] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:12 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:12.625177 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-213153e7-c9fd-4a13-bc5b-44bd41b3565d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:12.625791 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-213153e7-c9fd-4a13-bc5b-44bd41b3565d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:12.632069 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-213153e7-c9fd-4a13-bc5b-44bd41b3565d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:12.632551 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-213153e7-c9fd-4a13-bc5b-44bd41b3565d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:12.632987 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-213153e7-c9fd-4a13-bc5b-44bd41b3565d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:12.633671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-213153e7-c9fd-4a13-bc5b-44bd41b3565d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:12.634124 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-213153e7-c9fd-4a13-bc5b-44bd41b3565d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:12.634549 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-213153e7-c9fd-4a13-bc5b-44bd41b3565d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:12.759723 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-213153e7-c9fd-4a13-bc5b-44bd41b3565d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:12.767792 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-213153e7-c9fd-4a13-bc5b-44bd41b3565d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.145952 Oct 06 12:26:12.768358 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 269/531] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:12 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:12.963704 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b91b3755-22d4-46b7-9e77-1854017480f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:12.964314 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b91b3755-22d4-46b7-9e77-1854017480f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:12.970141 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b91b3755-22d4-46b7-9e77-1854017480f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:12.971285 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b91b3755-22d4-46b7-9e77-1854017480f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:12.971751 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b91b3755-22d4-46b7-9e77-1854017480f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:12.972434 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b91b3755-22d4-46b7-9e77-1854017480f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:12.972889 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b91b3755-22d4-46b7-9e77-1854017480f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:12.973310 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b91b3755-22d4-46b7-9e77-1854017480f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:13.031888 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b91b3755-22d4-46b7-9e77-1854017480f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:13.039894 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b91b3755-22d4-46b7-9e77-1854017480f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1191 microversion: 2.1 time: 0.080003 Oct 06 12:26:13.040453 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 263/532] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:12 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1191 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:13.570295 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9b320be4-fdd3-4032-95e8-d50ce519f94e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:13.570826 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9b320be4-fdd3-4032-95e8-d50ce519f94e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:13.576713 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b320be4-fdd3-4032-95e8-d50ce519f94e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:13.577185 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b320be4-fdd3-4032-95e8-d50ce519f94e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:13.577614 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b320be4-fdd3-4032-95e8-d50ce519f94e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:13.578288 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b320be4-fdd3-4032-95e8-d50ce519f94e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:13.578741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b320be4-fdd3-4032-95e8-d50ce519f94e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:13.579156 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b320be4-fdd3-4032-95e8-d50ce519f94e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:13.704025 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9b320be4-fdd3-4032-95e8-d50ce519f94e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:13.711435 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9b320be4-fdd3-4032-95e8-d50ce519f94e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.145072 Oct 06 12:26:13.712040 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 270/533] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:13 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:13.791064 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4b61b0b0-f26b-443a-9337-da06dea157cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:13.791689 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4b61b0b0-f26b-443a-9337-da06dea157cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:13.797480 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b61b0b0-f26b-443a-9337-da06dea157cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:13.797953 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b61b0b0-f26b-443a-9337-da06dea157cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:13.798879 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b61b0b0-f26b-443a-9337-da06dea157cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:13.799834 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b61b0b0-f26b-443a-9337-da06dea157cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:13.800278 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b61b0b0-f26b-443a-9337-da06dea157cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:13.800694 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4b61b0b0-f26b-443a-9337-da06dea157cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:13.924636 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4b61b0b0-f26b-443a-9337-da06dea157cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:13.932439 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4b61b0b0-f26b-443a-9337-da06dea157cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.145109 Oct 06 12:26:13.932997 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 264/534] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:13 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:14.062303 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7f3290e7-bff4-48d5-8c5b-8533760e54a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:14.062998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7f3290e7-bff4-48d5-8c5b-8533760e54a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:14.064859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:14.070397 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f3290e7-bff4-48d5-8c5b-8533760e54a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:14.070884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f3290e7-bff4-48d5-8c5b-8533760e54a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:14.071319 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f3290e7-bff4-48d5-8c5b-8533760e54a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:14.072039 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f3290e7-bff4-48d5-8c5b-8533760e54a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:14.072497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f3290e7-bff4-48d5-8c5b-8533760e54a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:14.072920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f3290e7-bff4-48d5-8c5b-8533760e54a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:14.132202 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7f3290e7-bff4-48d5-8c5b-8533760e54a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:14.139630 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7f3290e7-bff4-48d5-8c5b-8533760e54a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1191 microversion: 2.1 time: 0.081233 Oct 06 12:26:14.140191 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 271/535] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:14 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1191 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:14.733987 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-410f9bfb-8b37-420d-b030-1c6fe35878d6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:14.734529 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-410f9bfb-8b37-420d-b030-1c6fe35878d6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:14.741028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-410f9bfb-8b37-420d-b030-1c6fe35878d6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:14.741506 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-410f9bfb-8b37-420d-b030-1c6fe35878d6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:14.741937 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-410f9bfb-8b37-420d-b030-1c6fe35878d6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:14.742613 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-410f9bfb-8b37-420d-b030-1c6fe35878d6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:14.743062 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-410f9bfb-8b37-420d-b030-1c6fe35878d6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:14.743484 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-410f9bfb-8b37-420d-b030-1c6fe35878d6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:14.874545 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-410f9bfb-8b37-420d-b030-1c6fe35878d6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:14.882155 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-410f9bfb-8b37-420d-b030-1c6fe35878d6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.152249 Oct 06 12:26:14.882709 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 265/536] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:14 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:14.954102 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-56577746-031f-4080-941a-49f77c87c4cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:14.955221 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-56577746-031f-4080-941a-49f77c87c4cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:14.961685 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-56577746-031f-4080-941a-49f77c87c4cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:14.962164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-56577746-031f-4080-941a-49f77c87c4cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:14.962606 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-56577746-031f-4080-941a-49f77c87c4cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:14.963310 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-56577746-031f-4080-941a-49f77c87c4cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:14.963797 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-56577746-031f-4080-941a-49f77c87c4cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:14.964222 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-56577746-031f-4080-941a-49f77c87c4cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:15.091394 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-56577746-031f-4080-941a-49f77c87c4cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:15.098959 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-56577746-031f-4080-941a-49f77c87c4cc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1318 microversion: 2.1 time: 0.148707 Oct 06 12:26:15.099859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 272/537] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:14 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:15.163553 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0eeb2347-c2d9-4ea8-af5d-b0e122644e4b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:15.163553 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0eeb2347-c2d9-4ea8-af5d-b0e122644e4b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:15.173142 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0eeb2347-c2d9-4ea8-af5d-b0e122644e4b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:15.174408 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0eeb2347-c2d9-4ea8-af5d-b0e122644e4b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:15.175007 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0eeb2347-c2d9-4ea8-af5d-b0e122644e4b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:15.176477 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0eeb2347-c2d9-4ea8-af5d-b0e122644e4b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:15.177038 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0eeb2347-c2d9-4ea8-af5d-b0e122644e4b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:15.177540 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0eeb2347-c2d9-4ea8-af5d-b0e122644e4b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:15.398593 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0eeb2347-c2d9-4ea8-af5d-b0e122644e4b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:15.407372 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0eeb2347-c2d9-4ea8-af5d-b0e122644e4b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1199 microversion: 2.1 time: 0.248799 Oct 06 12:26:15.409104 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 266/538] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:15 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1199 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:15.907309 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b93aac01-5f7b-47ce-907b-4ed44caaa8ab tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:15.909436 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b93aac01-5f7b-47ce-907b-4ed44caaa8ab tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:15.929643 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b93aac01-5f7b-47ce-907b-4ed44caaa8ab tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:15.933530 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b93aac01-5f7b-47ce-907b-4ed44caaa8ab tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:15.934200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b93aac01-5f7b-47ce-907b-4ed44caaa8ab tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:15.935095 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b93aac01-5f7b-47ce-907b-4ed44caaa8ab tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:15.945209 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b93aac01-5f7b-47ce-907b-4ed44caaa8ab tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:15.945886 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b93aac01-5f7b-47ce-907b-4ed44caaa8ab tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:16.122198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2e978b5a-9c0c-4251-af3a-53b5fa1635b1 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:16.122814 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2e978b5a-9c0c-4251-af3a-53b5fa1635b1 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:16.138602 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2e978b5a-9c0c-4251-af3a-53b5fa1635b1 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:16.139112 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2e978b5a-9c0c-4251-af3a-53b5fa1635b1 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:16.139697 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2e978b5a-9c0c-4251-af3a-53b5fa1635b1 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:16.140410 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2e978b5a-9c0c-4251-af3a-53b5fa1635b1 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:16.141072 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2e978b5a-9c0c-4251-af3a-53b5fa1635b1 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:16.141660 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2e978b5a-9c0c-4251-af3a-53b5fa1635b1 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:16.199628 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b93aac01-5f7b-47ce-907b-4ed44caaa8ab tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:16.209280 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b93aac01-5f7b-47ce-907b-4ed44caaa8ab tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.308836 Oct 06 12:26:16.224104 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 273/539] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:15 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:16.434516 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-63cb8751-adcb-442e-bcde-8a1c1a5966f4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:16.435498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-63cb8751-adcb-442e-bcde-8a1c1a5966f4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:16.453352 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63cb8751-adcb-442e-bcde-8a1c1a5966f4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:16.455416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63cb8751-adcb-442e-bcde-8a1c1a5966f4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:16.456069 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63cb8751-adcb-442e-bcde-8a1c1a5966f4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:16.458630 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63cb8751-adcb-442e-bcde-8a1c1a5966f4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:16.459279 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63cb8751-adcb-442e-bcde-8a1c1a5966f4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:16.459907 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63cb8751-adcb-442e-bcde-8a1c1a5966f4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:16.487326 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2e978b5a-9c0c-4251-af3a-53b5fa1635b1 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:16.501277 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2e978b5a-9c0c-4251-af3a-53b5fa1635b1 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1506 microversion: 2.1 time: 0.382182 Oct 06 12:26:16.505465 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 267/540] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:16 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:16.694052 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-63cb8751-adcb-442e-bcde-8a1c1a5966f4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:16.703803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-63cb8751-adcb-442e-bcde-8a1c1a5966f4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1209 microversion: 2.1 time: 0.276110 Oct 06 12:26:16.705871 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 274/541] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:16 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1209 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:17.234008 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-81cdb606-f905-4d6b-9881-4ab224e59de4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:17.234778 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-81cdb606-f905-4d6b-9881-4ab224e59de4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:17.255310 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81cdb606-f905-4d6b-9881-4ab224e59de4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:17.259101 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81cdb606-f905-4d6b-9881-4ab224e59de4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:17.260754 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81cdb606-f905-4d6b-9881-4ab224e59de4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:17.264129 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81cdb606-f905-4d6b-9881-4ab224e59de4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:17.267322 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81cdb606-f905-4d6b-9881-4ab224e59de4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:17.270809 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81cdb606-f905-4d6b-9881-4ab224e59de4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:17.471108 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-81cdb606-f905-4d6b-9881-4ab224e59de4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:17.479458 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-81cdb606-f905-4d6b-9881-4ab224e59de4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.250009 Oct 06 12:26:17.480368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 268/542] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:17 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:17.733320 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1cad78be-0217-4579-b4f7-09488e2022a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:17.737734 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-1cad78be-0217-4579-b4f7-09488e2022a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:17.753336 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1cad78be-0217-4579-b4f7-09488e2022a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:17.755519 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1cad78be-0217-4579-b4f7-09488e2022a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:17.757765 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1cad78be-0217-4579-b4f7-09488e2022a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:17.760141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1cad78be-0217-4579-b4f7-09488e2022a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:17.763429 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1cad78be-0217-4579-b4f7-09488e2022a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:17.764125 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1cad78be-0217-4579-b4f7-09488e2022a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:17.989410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-1cad78be-0217-4579-b4f7-09488e2022a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:18.001904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-1cad78be-0217-4579-b4f7-09488e2022a7 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1277 microversion: 2.1 time: 0.276147 Oct 06 12:26:18.002887 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 275/543] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:17 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1277 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:18.022594 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-659d39c3-9c97-4abb-90ab-81cd1fdaabfe req-13e21a66-0124-4166-a0cb-ce6e34daf663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a965adee-462e-4616-9ffe-bcb94e58c7ae", "tag": "99d2670f-f58f-45d7-a104-307b021263f0"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:26:18.051598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-659d39c3-9c97-4abb-90ab-81cd1fdaabfe req-13e21a66-0124-4166-a0cb-ce6e34daf663 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:18.052504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-659d39c3-9c97-4abb-90ab-81cd1fdaabfe req-13e21a66-0124-4166-a0cb-ce6e34daf663 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:18.053118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-659d39c3-9c97-4abb-90ab-81cd1fdaabfe req-13e21a66-0124-4166-a0cb-ce6e34daf663 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:18.083783 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-659d39c3-9c97-4abb-90ab-81cd1fdaabfe req-13e21a66-0124-4166-a0cb-ce6e34daf663 service nova] Creating event network-changed:99d2670f-f58f-45d7-a104-307b021263f0 for instance a965adee-462e-4616-9ffe-bcb94e58c7ae on hv-cinder-85604 Oct 06 12:26:18.088967 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-659d39c3-9c97-4abb-90ab-81cd1fdaabfe req-13e21a66-0124-4166-a0cb-ce6e34daf663 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074788 Oct 06 12:26:18.089910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 269/544] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:26:18.509589 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9e9e609d-908b-4192-8bbd-a3f498f1bd4a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:18.510170 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9e9e609d-908b-4192-8bbd-a3f498f1bd4a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:18.524573 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9e9e609d-908b-4192-8bbd-a3f498f1bd4a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:18.525391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9e9e609d-908b-4192-8bbd-a3f498f1bd4a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:18.526062 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9e9e609d-908b-4192-8bbd-a3f498f1bd4a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:18.526791 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9e9e609d-908b-4192-8bbd-a3f498f1bd4a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:18.527248 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9e9e609d-908b-4192-8bbd-a3f498f1bd4a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:18.527753 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9e9e609d-908b-4192-8bbd-a3f498f1bd4a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:18.674446 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9e9e609d-908b-4192-8bbd-a3f498f1bd4a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:18.688090 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9e9e609d-908b-4192-8bbd-a3f498f1bd4a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.183034 Oct 06 12:26:18.689886 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 276/545] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:18 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:19.026428 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-cf6811c8-49c5-4942-9947-b85704240157 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:19.027851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-cf6811c8-49c5-4942-9947-b85704240157 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:19.034941 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cf6811c8-49c5-4942-9947-b85704240157 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:19.035433 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cf6811c8-49c5-4942-9947-b85704240157 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:19.035907 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cf6811c8-49c5-4942-9947-b85704240157 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:19.036609 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cf6811c8-49c5-4942-9947-b85704240157 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:19.037058 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cf6811c8-49c5-4942-9947-b85704240157 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:19.037482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cf6811c8-49c5-4942-9947-b85704240157 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:19.184512 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-cf6811c8-49c5-4942-9947-b85704240157 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:19.192998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-cf6811c8-49c5-4942-9947-b85704240157 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1277 microversion: 2.1 time: 0.170972 Oct 06 12:26:19.193880 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 270/546] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:19 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:19.718205 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-fe64ac6d-345a-4166-9d61-50fa3d703c36 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:19.719256 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-fe64ac6d-345a-4166-9d61-50fa3d703c36 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:19.728961 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fe64ac6d-345a-4166-9d61-50fa3d703c36 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:19.729764 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fe64ac6d-345a-4166-9d61-50fa3d703c36 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:19.730499 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fe64ac6d-345a-4166-9d61-50fa3d703c36 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:19.731372 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fe64ac6d-345a-4166-9d61-50fa3d703c36 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:19.732205 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fe64ac6d-345a-4166-9d61-50fa3d703c36 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:19.732866 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fe64ac6d-345a-4166-9d61-50fa3d703c36 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:19.955976 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-fe64ac6d-345a-4166-9d61-50fa3d703c36 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:19.964421 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-fe64ac6d-345a-4166-9d61-50fa3d703c36 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.250614 Oct 06 12:26:19.965016 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 277/547] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:19 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:20.216619 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0b99ec82-de4b-464f-b32a-f1b98d5d45ea tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:20.217958 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0b99ec82-de4b-464f-b32a-f1b98d5d45ea tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:20.224849 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0b99ec82-de4b-464f-b32a-f1b98d5d45ea tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:20.225360 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0b99ec82-de4b-464f-b32a-f1b98d5d45ea tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:20.225788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0b99ec82-de4b-464f-b32a-f1b98d5d45ea tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:20.226474 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0b99ec82-de4b-464f-b32a-f1b98d5d45ea tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:20.226918 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0b99ec82-de4b-464f-b32a-f1b98d5d45ea tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:20.227338 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0b99ec82-de4b-464f-b32a-f1b98d5d45ea tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:20.387961 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0b99ec82-de4b-464f-b32a-f1b98d5d45ea tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:20.396273 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0b99ec82-de4b-464f-b32a-f1b98d5d45ea tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1277 microversion: 2.1 time: 0.183648 Oct 06 12:26:20.407845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 271/548] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:20 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:20.987966 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4db18937-5b18-492c-aa65-d63282df271c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:20.988801 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-4db18937-5b18-492c-aa65-d63282df271c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:20.997582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4db18937-5b18-492c-aa65-d63282df271c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:20.998303 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4db18937-5b18-492c-aa65-d63282df271c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:20.998946 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4db18937-5b18-492c-aa65-d63282df271c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:20.999882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4db18937-5b18-492c-aa65-d63282df271c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:21.000547 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4db18937-5b18-492c-aa65-d63282df271c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:21.001272 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4db18937-5b18-492c-aa65-d63282df271c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:21.147752 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4db18937-5b18-492c-aa65-d63282df271c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:21.156040 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4db18937-5b18-492c-aa65-d63282df271c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.172533 Oct 06 12:26:21.158810 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 278/549] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:20 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:21.422342 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5b63f873-1e85-4ca0-8bed-6ca85c318942 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:21.423726 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5b63f873-1e85-4ca0-8bed-6ca85c318942 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:21.431931 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b63f873-1e85-4ca0-8bed-6ca85c318942 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:21.432458 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b63f873-1e85-4ca0-8bed-6ca85c318942 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:21.432906 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b63f873-1e85-4ca0-8bed-6ca85c318942 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:21.433595 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b63f873-1e85-4ca0-8bed-6ca85c318942 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:21.434327 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b63f873-1e85-4ca0-8bed-6ca85c318942 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:21.434807 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b63f873-1e85-4ca0-8bed-6ca85c318942 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:21.454043 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=100 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:21.595870 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5b63f873-1e85-4ca0-8bed-6ca85c318942 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:21.604192 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5b63f873-1e85-4ca0-8bed-6ca85c318942 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1277 microversion: 2.1 time: 0.185814 Oct 06 12:26:21.605093 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 272/550] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:21 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:22.181286 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-55ec66a9-57ee-4e1e-bef6-0f2b65947e6a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:22.181920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-55ec66a9-57ee-4e1e-bef6-0f2b65947e6a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:22.191092 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-55ec66a9-57ee-4e1e-bef6-0f2b65947e6a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:22.191615 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-55ec66a9-57ee-4e1e-bef6-0f2b65947e6a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:22.192052 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-55ec66a9-57ee-4e1e-bef6-0f2b65947e6a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:22.192964 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-55ec66a9-57ee-4e1e-bef6-0f2b65947e6a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:22.193426 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-55ec66a9-57ee-4e1e-bef6-0f2b65947e6a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:22.193847 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-55ec66a9-57ee-4e1e-bef6-0f2b65947e6a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:22.351207 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-55ec66a9-57ee-4e1e-bef6-0f2b65947e6a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:22.366124 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-55ec66a9-57ee-4e1e-bef6-0f2b65947e6a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.188578 Oct 06 12:26:22.367232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 279/551] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:22 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:22.631362 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8621f4e3-c2bd-46da-923c-682366c0f732 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:22.632004 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8621f4e3-c2bd-46da-923c-682366c0f732 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:22.641038 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8621f4e3-c2bd-46da-923c-682366c0f732 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:22.641580 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8621f4e3-c2bd-46da-923c-682366c0f732 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:22.642004 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8621f4e3-c2bd-46da-923c-682366c0f732 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:22.642706 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8621f4e3-c2bd-46da-923c-682366c0f732 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:22.643164 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8621f4e3-c2bd-46da-923c-682366c0f732 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:22.643614 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8621f4e3-c2bd-46da-923c-682366c0f732 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:22.832953 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8621f4e3-c2bd-46da-923c-682366c0f732 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:22.843628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8621f4e3-c2bd-46da-923c-682366c0f732 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1277 microversion: 2.1 time: 0.217665 Oct 06 12:26:22.859403 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 273/552] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:22 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1277 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:23.170797 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-bbf23306-098a-4978-9178-5ae743990928 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:26:23.178143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bbf23306-098a-4978-9178-5ae743990928 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:23.178839 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bbf23306-098a-4978-9178-5ae743990928 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:23.180118 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bbf23306-098a-4978-9178-5ae743990928 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:23.256625 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-bbf23306-098a-4978-9178-5ae743990928 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Going to try to stop instance {{(pid=120508) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 12:26:23.304669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-bbf23306-098a-4978-9178-5ae743990928 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "POST /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/action" status: 202 len: 0 microversion: 2.1 time: 0.137694 Oct 06 12:26:23.308411 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 280/553] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 12:26:23 2022] POST /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:26:23.316174 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3c8c704c-372c-4f78-a169-0817be24675c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:23.316901 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3c8c704c-372c-4f78-a169-0817be24675c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:23.323342 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3c8c704c-372c-4f78-a169-0817be24675c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:23.323895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3c8c704c-372c-4f78-a169-0817be24675c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:23.324331 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3c8c704c-372c-4f78-a169-0817be24675c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:23.325034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3c8c704c-372c-4f78-a169-0817be24675c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:23.325486 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3c8c704c-372c-4f78-a169-0817be24675c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:23.325908 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3c8c704c-372c-4f78-a169-0817be24675c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:23.391685 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-190480d3-cbdb-4313-9b6e-127e1c3bcc73 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:23.392389 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-190480d3-cbdb-4313-9b6e-127e1c3bcc73 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:23.400227 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-190480d3-cbdb-4313-9b6e-127e1c3bcc73 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:23.401223 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-190480d3-cbdb-4313-9b6e-127e1c3bcc73 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:23.401915 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-190480d3-cbdb-4313-9b6e-127e1c3bcc73 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:23.402875 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-190480d3-cbdb-4313-9b6e-127e1c3bcc73 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:23.403497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-190480d3-cbdb-4313-9b6e-127e1c3bcc73 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:23.404103 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-190480d3-cbdb-4313-9b6e-127e1c3bcc73 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:23.514823 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3c8c704c-372c-4f78-a169-0817be24675c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:23.526985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3c8c704c-372c-4f78-a169-0817be24675c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1724 microversion: 2.1 time: 0.217176 Oct 06 12:26:23.528269 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 274/554] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:23 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:23.633753 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-190480d3-cbdb-4313-9b6e-127e1c3bcc73 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:23.648726 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-190480d3-cbdb-4313-9b6e-127e1c3bcc73 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.259193 Oct 06 12:26:23.652531 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 281/555] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:23 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:23.882104 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8a9376d1-ba7c-486f-b030-23e8996f1027 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:23.884087 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8a9376d1-ba7c-486f-b030-23e8996f1027 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:23.891357 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8a9376d1-ba7c-486f-b030-23e8996f1027 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:23.892278 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8a9376d1-ba7c-486f-b030-23e8996f1027 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:23.892832 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8a9376d1-ba7c-486f-b030-23e8996f1027 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:23.893756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8a9376d1-ba7c-486f-b030-23e8996f1027 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:23.894476 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8a9376d1-ba7c-486f-b030-23e8996f1027 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:23.895016 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8a9376d1-ba7c-486f-b030-23e8996f1027 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:24.096164 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8a9376d1-ba7c-486f-b030-23e8996f1027 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:24.104475 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8a9376d1-ba7c-486f-b030-23e8996f1027 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1277 microversion: 2.1 time: 0.226591 Oct 06 12:26:24.105245 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 275/556] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:23 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:24.550578 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f5ca91eb-16ff-4459-a69c-3059a07a6f82 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:24.551314 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f5ca91eb-16ff-4459-a69c-3059a07a6f82 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:24.558274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f5ca91eb-16ff-4459-a69c-3059a07a6f82 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:24.559050 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f5ca91eb-16ff-4459-a69c-3059a07a6f82 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:24.559719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f5ca91eb-16ff-4459-a69c-3059a07a6f82 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:24.560442 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f5ca91eb-16ff-4459-a69c-3059a07a6f82 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:24.561083 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f5ca91eb-16ff-4459-a69c-3059a07a6f82 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:24.561522 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f5ca91eb-16ff-4459-a69c-3059a07a6f82 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:24.566521 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:24.678603 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-429f2121-85b8-4a1e-9d4f-7815083dabad tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:24.679654 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-429f2121-85b8-4a1e-9d4f-7815083dabad tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:24.686718 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-429f2121-85b8-4a1e-9d4f-7815083dabad tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:24.687431 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-429f2121-85b8-4a1e-9d4f-7815083dabad tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:24.688135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-429f2121-85b8-4a1e-9d4f-7815083dabad tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:24.689855 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-429f2121-85b8-4a1e-9d4f-7815083dabad tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:24.690420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-429f2121-85b8-4a1e-9d4f-7815083dabad tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:24.690892 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-429f2121-85b8-4a1e-9d4f-7815083dabad tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:24.715848 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f5ca91eb-16ff-4459-a69c-3059a07a6f82 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:24.725686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f5ca91eb-16ff-4459-a69c-3059a07a6f82 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1724 microversion: 2.1 time: 0.178614 Oct 06 12:26:24.726664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 282/557] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:24 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:24.890848 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-429f2121-85b8-4a1e-9d4f-7815083dabad tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:24.900449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-429f2121-85b8-4a1e-9d4f-7815083dabad tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.226401 Oct 06 12:26:24.901080 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 276/558] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:24 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:25.129171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a5606dc5-4639-45f9-9d39-f1ec55cd3a0a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:25.129801 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a5606dc5-4639-45f9-9d39-f1ec55cd3a0a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:25.142531 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5606dc5-4639-45f9-9d39-f1ec55cd3a0a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:25.143342 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5606dc5-4639-45f9-9d39-f1ec55cd3a0a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:25.143964 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5606dc5-4639-45f9-9d39-f1ec55cd3a0a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:25.144857 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5606dc5-4639-45f9-9d39-f1ec55cd3a0a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:25.145574 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5606dc5-4639-45f9-9d39-f1ec55cd3a0a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:25.146206 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5606dc5-4639-45f9-9d39-f1ec55cd3a0a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:25.290165 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-d2b5050b-13cd-430c-bf05-7e9aef20a18d req-82786ae1-9e28-4390-b09a-675653f41e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb42d057-804d-4d87-953a-953bf69fe126", "name": "network-vif-plugged", "status": "completed", "tag": "9a4b9943-b074-4a4d-a9c2-a11438741a56"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:26:25.306237 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-d2b5050b-13cd-430c-bf05-7e9aef20a18d req-82786ae1-9e28-4390-b09a-675653f41e27 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:25.307141 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-d2b5050b-13cd-430c-bf05-7e9aef20a18d req-82786ae1-9e28-4390-b09a-675653f41e27 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:25.307818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-d2b5050b-13cd-430c-bf05-7e9aef20a18d req-82786ae1-9e28-4390-b09a-675653f41e27 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:25.328261 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-d2b5050b-13cd-430c-bf05-7e9aef20a18d req-82786ae1-9e28-4390-b09a-675653f41e27 service nova] Creating event network-vif-plugged:9a4b9943-b074-4a4d-a9c2-a11438741a56 for instance eb42d057-804d-4d87-953a-953bf69fe126 on hv-cinder-85604 Oct 06 12:26:25.335372 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a5606dc5-4639-45f9-9d39-f1ec55cd3a0a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:25.347016 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a5606dc5-4639-45f9-9d39-f1ec55cd3a0a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1265 microversion: 2.1 time: 0.222303 Oct 06 12:26:25.371710 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 283/559] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:25 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:25.372905 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-d2b5050b-13cd-430c-bf05-7e9aef20a18d req-82786ae1-9e28-4390-b09a-675653f41e27 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087640 Oct 06 12:26:25.373966 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 277/560] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:26:25.758995 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-32daacda-0eb9-4d0a-98ab-27ee2bc7936b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:25.759686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-32daacda-0eb9-4d0a-98ab-27ee2bc7936b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:25.766465 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32daacda-0eb9-4d0a-98ab-27ee2bc7936b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:25.766960 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32daacda-0eb9-4d0a-98ab-27ee2bc7936b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:25.767609 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32daacda-0eb9-4d0a-98ab-27ee2bc7936b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:25.768475 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32daacda-0eb9-4d0a-98ab-27ee2bc7936b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:25.769141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32daacda-0eb9-4d0a-98ab-27ee2bc7936b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:25.769777 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32daacda-0eb9-4d0a-98ab-27ee2bc7936b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:25.928116 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-36717aff-8b07-45ff-837f-aaff9b1de60c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:25.928981 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-36717aff-8b07-45ff-837f-aaff9b1de60c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:25.936697 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-32daacda-0eb9-4d0a-98ab-27ee2bc7936b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:25.939995 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36717aff-8b07-45ff-837f-aaff9b1de60c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:25.940490 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36717aff-8b07-45ff-837f-aaff9b1de60c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:25.940924 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36717aff-8b07-45ff-837f-aaff9b1de60c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:25.941850 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36717aff-8b07-45ff-837f-aaff9b1de60c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:25.942563 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36717aff-8b07-45ff-837f-aaff9b1de60c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:25.943127 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36717aff-8b07-45ff-837f-aaff9b1de60c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:25.946283 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-32daacda-0eb9-4d0a-98ab-27ee2bc7936b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1724 microversion: 2.1 time: 0.191056 Oct 06 12:26:25.947559 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 284/561] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:25 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:26.160221 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-36717aff-8b07-45ff-837f-aaff9b1de60c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:26.168178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-36717aff-8b07-45ff-837f-aaff9b1de60c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.245793 Oct 06 12:26:26.169284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 278/562] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:25 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:26.374007 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6dd5c2be-9a2c-4b57-a198-d85007299014 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:26.374619 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-6dd5c2be-9a2c-4b57-a198-d85007299014 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:26.381253 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6dd5c2be-9a2c-4b57-a198-d85007299014 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:26.381741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6dd5c2be-9a2c-4b57-a198-d85007299014 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:26.382187 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6dd5c2be-9a2c-4b57-a198-d85007299014 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:26.382913 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6dd5c2be-9a2c-4b57-a198-d85007299014 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:26.383385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6dd5c2be-9a2c-4b57-a198-d85007299014 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:26.383839 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6dd5c2be-9a2c-4b57-a198-d85007299014 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:26.525288 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6dd5c2be-9a2c-4b57-a198-d85007299014 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:26.533388 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-6dd5c2be-9a2c-4b57-a198-d85007299014 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1265 microversion: 2.1 time: 0.163329 Oct 06 12:26:26.533963 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 285/563] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:26 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:26.974782 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f6ef9a74-c506-4f08-a23e-82ae3f52073b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:26.976049 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f6ef9a74-c506-4f08-a23e-82ae3f52073b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:26.982753 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f6ef9a74-c506-4f08-a23e-82ae3f52073b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:26.983691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f6ef9a74-c506-4f08-a23e-82ae3f52073b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:26.984348 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f6ef9a74-c506-4f08-a23e-82ae3f52073b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:26.986074 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f6ef9a74-c506-4f08-a23e-82ae3f52073b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:26.986732 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f6ef9a74-c506-4f08-a23e-82ae3f52073b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:26.987380 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f6ef9a74-c506-4f08-a23e-82ae3f52073b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:27.139499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f6ef9a74-c506-4f08-a23e-82ae3f52073b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:27.150138 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f6ef9a74-c506-4f08-a23e-82ae3f52073b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1724 microversion: 2.1 time: 0.179225 Oct 06 12:26:27.150712 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 279/564] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:26 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:27.192913 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a9a4c91b-c907-47a6-b1bd-a15a661cc37a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:27.193525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a9a4c91b-c907-47a6-b1bd-a15a661cc37a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:27.200216 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a9a4c91b-c907-47a6-b1bd-a15a661cc37a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:27.200711 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a9a4c91b-c907-47a6-b1bd-a15a661cc37a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:27.201146 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a9a4c91b-c907-47a6-b1bd-a15a661cc37a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:27.201860 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a9a4c91b-c907-47a6-b1bd-a15a661cc37a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:27.202300 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a9a4c91b-c907-47a6-b1bd-a15a661cc37a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:27.202728 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a9a4c91b-c907-47a6-b1bd-a15a661cc37a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:27.346574 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a9a4c91b-c907-47a6-b1bd-a15a661cc37a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:27.354773 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a9a4c91b-c907-47a6-b1bd-a15a661cc37a tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.166394 Oct 06 12:26:27.370747 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 286/565] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:27 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:27.556630 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b91c8430-395c-4535-bf76-c4c3f298bb6e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:27.557170 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b91c8430-395c-4535-bf76-c4c3f298bb6e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:27.563774 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b91c8430-395c-4535-bf76-c4c3f298bb6e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:27.564268 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b91c8430-395c-4535-bf76-c4c3f298bb6e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:27.564718 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b91c8430-395c-4535-bf76-c4c3f298bb6e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:27.565402 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b91c8430-395c-4535-bf76-c4c3f298bb6e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:27.565868 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b91c8430-395c-4535-bf76-c4c3f298bb6e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:27.566286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b91c8430-395c-4535-bf76-c4c3f298bb6e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:27.714411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b91c8430-395c-4535-bf76-c4c3f298bb6e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:27.722911 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b91c8430-395c-4535-bf76-c4c3f298bb6e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1265 microversion: 2.1 time: 0.170262 Oct 06 12:26:27.723863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 280/566] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:27 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:28.173408 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-17302600-c47d-40e2-a7e0-b2e0ba3aaff6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:28.174158 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-17302600-c47d-40e2-a7e0-b2e0ba3aaff6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:28.180674 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17302600-c47d-40e2-a7e0-b2e0ba3aaff6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:28.181176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17302600-c47d-40e2-a7e0-b2e0ba3aaff6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:28.181623 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17302600-c47d-40e2-a7e0-b2e0ba3aaff6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:28.182317 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17302600-c47d-40e2-a7e0-b2e0ba3aaff6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:28.182997 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17302600-c47d-40e2-a7e0-b2e0ba3aaff6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:28.183426 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17302600-c47d-40e2-a7e0-b2e0ba3aaff6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:28.339724 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-17302600-c47d-40e2-a7e0-b2e0ba3aaff6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:28.349613 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-17302600-c47d-40e2-a7e0-b2e0ba3aaff6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1724 microversion: 2.1 time: 0.180066 Oct 06 12:26:28.350803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 287/567] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:28 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:28.378703 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-de2b4440-d8a8-4871-b328-26e2048f83db tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:28.380005 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-de2b4440-d8a8-4871-b328-26e2048f83db tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:28.395895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-de2b4440-d8a8-4871-b328-26e2048f83db tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:28.396880 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-de2b4440-d8a8-4871-b328-26e2048f83db tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:28.397568 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-de2b4440-d8a8-4871-b328-26e2048f83db tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:28.398549 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-de2b4440-d8a8-4871-b328-26e2048f83db tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:28.399224 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-de2b4440-d8a8-4871-b328-26e2048f83db tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:28.399885 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-de2b4440-d8a8-4871-b328-26e2048f83db tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:28.582042 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-de2b4440-d8a8-4871-b328-26e2048f83db tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:28.596009 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-de2b4440-d8a8-4871-b328-26e2048f83db tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1359 microversion: 2.1 time: 0.217188 Oct 06 12:26:28.604434 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 281/568] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:28 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:28.746251 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-44607ac7-b524-4ad0-866c-1671056903d1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:28.747374 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-44607ac7-b524-4ad0-866c-1671056903d1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:28.755286 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-44607ac7-b524-4ad0-866c-1671056903d1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:28.756104 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-44607ac7-b524-4ad0-866c-1671056903d1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:28.756790 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-44607ac7-b524-4ad0-866c-1671056903d1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:28.757672 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-44607ac7-b524-4ad0-866c-1671056903d1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:28.758293 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-44607ac7-b524-4ad0-866c-1671056903d1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:28.758794 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-44607ac7-b524-4ad0-866c-1671056903d1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:28.932689 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-44607ac7-b524-4ad0-866c-1671056903d1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:28.942762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-44607ac7-b524-4ad0-866c-1671056903d1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1265 microversion: 2.1 time: 0.200857 Oct 06 12:26:28.943825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 288/569] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:28 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:29.373872 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3eab9e30-4950-43dd-80a0-a51a6f4ebd66 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:29.374753 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3eab9e30-4950-43dd-80a0-a51a6f4ebd66 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:29.381844 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3eab9e30-4950-43dd-80a0-a51a6f4ebd66 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:29.383073 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3eab9e30-4950-43dd-80a0-a51a6f4ebd66 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:29.383769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3eab9e30-4950-43dd-80a0-a51a6f4ebd66 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:29.384655 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3eab9e30-4950-43dd-80a0-a51a6f4ebd66 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:29.385283 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3eab9e30-4950-43dd-80a0-a51a6f4ebd66 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:29.385867 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3eab9e30-4950-43dd-80a0-a51a6f4ebd66 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:29.526841 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3eab9e30-4950-43dd-80a0-a51a6f4ebd66 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:29.536514 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3eab9e30-4950-43dd-80a0-a51a6f4ebd66 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1724 microversion: 2.1 time: 0.166756 Oct 06 12:26:29.537104 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 282/570] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:29 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:29.617855 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3fbe8cc1-d236-462d-8613-abfaa784e1fe tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:29.618528 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3fbe8cc1-d236-462d-8613-abfaa784e1fe tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:29.626683 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3fbe8cc1-d236-462d-8613-abfaa784e1fe tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:29.627198 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3fbe8cc1-d236-462d-8613-abfaa784e1fe tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:29.627753 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3fbe8cc1-d236-462d-8613-abfaa784e1fe tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:29.628727 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3fbe8cc1-d236-462d-8613-abfaa784e1fe tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:29.629187 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3fbe8cc1-d236-462d-8613-abfaa784e1fe tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:29.629684 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3fbe8cc1-d236-462d-8613-abfaa784e1fe tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:29.789600 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3fbe8cc1-d236-462d-8613-abfaa784e1fe tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:29.807331 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3fbe8cc1-d236-462d-8613-abfaa784e1fe tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1549 microversion: 2.1 time: 0.194074 Oct 06 12:26:29.807961 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 289/571] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:29 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1549 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:29.831967 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e640b594-a1ab-452d-abb2-a8d6568fcc5c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:29.832794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e640b594-a1ab-452d-abb2-a8d6568fcc5c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:29.839892 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e640b594-a1ab-452d-abb2-a8d6568fcc5c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:29.840466 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e640b594-a1ab-452d-abb2-a8d6568fcc5c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:29.840999 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e640b594-a1ab-452d-abb2-a8d6568fcc5c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:29.841786 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e640b594-a1ab-452d-abb2-a8d6568fcc5c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:29.842316 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e640b594-a1ab-452d-abb2-a8d6568fcc5c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:29.842815 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e640b594-a1ab-452d-abb2-a8d6568fcc5c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:29.969815 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2d9e1fe8-c88b-452f-ae17-e292a508c537 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:29.970481 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2d9e1fe8-c88b-452f-ae17-e292a508c537 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:29.979109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d9e1fe8-c88b-452f-ae17-e292a508c537 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:29.979848 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d9e1fe8-c88b-452f-ae17-e292a508c537 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:29.980371 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d9e1fe8-c88b-452f-ae17-e292a508c537 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:29.981350 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d9e1fe8-c88b-452f-ae17-e292a508c537 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:29.981810 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d9e1fe8-c88b-452f-ae17-e292a508c537 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:29.982406 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d9e1fe8-c88b-452f-ae17-e292a508c537 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:29.986981 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e640b594-a1ab-452d-abb2-a8d6568fcc5c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:29.997269 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e640b594-a1ab-452d-abb2-a8d6568fcc5c tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1549 microversion: 2.1 time: 0.169947 Oct 06 12:26:30.001423 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 283/572] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:29 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:30.023713 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ef9a7542-5d7a-47af-9b1e-35af842dffe4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:30.028961 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ef9a7542-5d7a-47af-9b1e-35af842dffe4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:30.029998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ef9a7542-5d7a-47af-9b1e-35af842dffe4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Searching by: {'deleted': False, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c'} {{(pid=120509) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 12:26:30.043195 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ef9a7542-5d7a-47af-9b1e-35af842dffe4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:30.043195 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ef9a7542-5d7a-47af-9b1e-35af842dffe4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:30.043195 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ef9a7542-5d7a-47af-9b1e-35af842dffe4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:30.043195 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ef9a7542-5d7a-47af-9b1e-35af842dffe4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:30.043839 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ef9a7542-5d7a-47af-9b1e-35af842dffe4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:30.043839 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ef9a7542-5d7a-47af-9b1e-35af842dffe4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:30.139571 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.multi_cell_list [None req-ef9a7542-5d7a-47af-9b1e-35af842dffe4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120509) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 12:26:30.170413 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2d9e1fe8-c88b-452f-ae17-e292a508c537 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:30.179167 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2d9e1fe8-c88b-452f-ae17-e292a508c537 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1265 microversion: 2.1 time: 0.216730 Oct 06 12:26:30.190189 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 290/573] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:29 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:30.245601 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ef9a7542-5d7a-47af-9b1e-35af842dffe4 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.225366 Oct 06 12:26:30.246437 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 284/574] 10.222.0.33 () {58 vars in 1125 bytes} [Thu Oct 6 12:26:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:26:30.258821 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3d72ab3c-1406-49a5-b66c-b23a5f4f3832 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:30.259530 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3d72ab3c-1406-49a5-b66c-b23a5f4f3832 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:30.269610 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3d72ab3c-1406-49a5-b66c-b23a5f4f3832 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:30.270416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3d72ab3c-1406-49a5-b66c-b23a5f4f3832 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:30.271057 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3d72ab3c-1406-49a5-b66c-b23a5f4f3832 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:30.272246 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3d72ab3c-1406-49a5-b66c-b23a5f4f3832 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:30.272809 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3d72ab3c-1406-49a5-b66c-b23a5f4f3832 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:30.273450 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3d72ab3c-1406-49a5-b66c-b23a5f4f3832 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:30.411684 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3d72ab3c-1406-49a5-b66c-b23a5f4f3832 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:30.419886 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3d72ab3c-1406-49a5-b66c-b23a5f4f3832 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1549 microversion: 2.1 time: 0.165040 Oct 06 12:26:30.420461 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 291/575] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:30 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:30.560210 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d05286dd-65d3-4837-8e63-f5822bd15c9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:30.560816 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d05286dd-65d3-4837-8e63-f5822bd15c9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:30.567236 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d05286dd-65d3-4837-8e63-f5822bd15c9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:30.568016 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d05286dd-65d3-4837-8e63-f5822bd15c9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:30.568463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d05286dd-65d3-4837-8e63-f5822bd15c9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:30.569198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d05286dd-65d3-4837-8e63-f5822bd15c9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:30.569660 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d05286dd-65d3-4837-8e63-f5822bd15c9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:30.570272 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d05286dd-65d3-4837-8e63-f5822bd15c9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:30.735992 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d05286dd-65d3-4837-8e63-f5822bd15c9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:30.763667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d05286dd-65d3-4837-8e63-f5822bd15c9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1724 microversion: 2.1 time: 0.207209 Oct 06 12:26:30.768810 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 285/576] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:30 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:31.217872 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9be5f65f-61c7-4c7f-9c86-c7f0c8839bc1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:31.218809 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9be5f65f-61c7-4c7f-9c86-c7f0c8839bc1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:31.227108 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9be5f65f-61c7-4c7f-9c86-c7f0c8839bc1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:31.227679 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9be5f65f-61c7-4c7f-9c86-c7f0c8839bc1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:31.228822 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9be5f65f-61c7-4c7f-9c86-c7f0c8839bc1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:31.229954 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9be5f65f-61c7-4c7f-9c86-c7f0c8839bc1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:31.230573 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9be5f65f-61c7-4c7f-9c86-c7f0c8839bc1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:31.231120 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9be5f65f-61c7-4c7f-9c86-c7f0c8839bc1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:31.398151 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9be5f65f-61c7-4c7f-9c86-c7f0c8839bc1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:31.409738 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9be5f65f-61c7-4c7f-9c86-c7f0c8839bc1 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1265 microversion: 2.1 time: 0.196294 Oct 06 12:26:31.410481 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 292/577] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:31 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:31.795461 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8136db57-85ff-442c-ac7e-98cabc98f226 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:31.796568 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8136db57-85ff-442c-ac7e-98cabc98f226 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:31.803813 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8136db57-85ff-442c-ac7e-98cabc98f226 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:31.804524 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8136db57-85ff-442c-ac7e-98cabc98f226 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:31.805502 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8136db57-85ff-442c-ac7e-98cabc98f226 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:31.806213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8136db57-85ff-442c-ac7e-98cabc98f226 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:31.806768 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8136db57-85ff-442c-ac7e-98cabc98f226 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:31.807587 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8136db57-85ff-442c-ac7e-98cabc98f226 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:31.975064 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8136db57-85ff-442c-ac7e-98cabc98f226 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:31.983857 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8136db57-85ff-442c-ac7e-98cabc98f226 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1724 microversion: 2.1 time: 0.192659 Oct 06 12:26:31.999301 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 286/578] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:31 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:32.433865 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-da125d09-f0a6-435f-bdfb-c1e6488e3d64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:32.434651 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-da125d09-f0a6-435f-bdfb-c1e6488e3d64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:32.442018 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da125d09-f0a6-435f-bdfb-c1e6488e3d64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:32.442820 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da125d09-f0a6-435f-bdfb-c1e6488e3d64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:32.443380 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da125d09-f0a6-435f-bdfb-c1e6488e3d64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:32.444263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da125d09-f0a6-435f-bdfb-c1e6488e3d64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:32.444825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da125d09-f0a6-435f-bdfb-c1e6488e3d64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:32.445355 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da125d09-f0a6-435f-bdfb-c1e6488e3d64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:32.591992 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-da125d09-f0a6-435f-bdfb-c1e6488e3d64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:32.602613 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-da125d09-f0a6-435f-bdfb-c1e6488e3d64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1265 microversion: 2.1 time: 0.172573 Oct 06 12:26:32.604292 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 293/579] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:32 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:33.006480 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0064f9db-1ca8-43a9-960d-e4877fd8cd02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:33.008326 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0064f9db-1ca8-43a9-960d-e4877fd8cd02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:33.014663 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0064f9db-1ca8-43a9-960d-e4877fd8cd02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:33.015149 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0064f9db-1ca8-43a9-960d-e4877fd8cd02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:33.015608 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0064f9db-1ca8-43a9-960d-e4877fd8cd02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:33.016952 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0064f9db-1ca8-43a9-960d-e4877fd8cd02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:33.017402 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0064f9db-1ca8-43a9-960d-e4877fd8cd02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:33.018095 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0064f9db-1ca8-43a9-960d-e4877fd8cd02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:33.206747 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a69de412-5789-4c2e-b287-64749a18b828 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c79956b2-ce79-46f0-890e-d7ac69ad9081"}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:26:33.209609 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a69de412-5789-4c2e-b287-64749a18b828 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:33.215922 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a69de412-5789-4c2e-b287-64749a18b828 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:33.216639 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a69de412-5789-4c2e-b287-64749a18b828 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:33.217237 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a69de412-5789-4c2e-b287-64749a18b828 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:33.218217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a69de412-5789-4c2e-b287-64749a18b828 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:33.218927 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a69de412-5789-4c2e-b287-64749a18b828 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:33.220015 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a69de412-5789-4c2e-b287-64749a18b828 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:33.236745 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0064f9db-1ca8-43a9-960d-e4877fd8cd02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:33.249186 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0064f9db-1ca8-43a9-960d-e4877fd8cd02 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1724 microversion: 2.1 time: 0.246520 Oct 06 12:26:33.250390 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 287/580] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:33 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:33.627813 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-24aafe80-31ba-44a2-8fc0-0dc3804ad2fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:33.628812 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-24aafe80-31ba-44a2-8fc0-0dc3804ad2fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:33.631282 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a69de412-5789-4c2e-b287-64749a18b828 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "POST /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428599 Oct 06 12:26:33.632620 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 294/581] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 12:26:33 2022] POST /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:26:33.636221 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-24aafe80-31ba-44a2-8fc0-0dc3804ad2fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:33.636721 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-24aafe80-31ba-44a2-8fc0-0dc3804ad2fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:33.637246 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-24aafe80-31ba-44a2-8fc0-0dc3804ad2fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:33.638124 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-24aafe80-31ba-44a2-8fc0-0dc3804ad2fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:33.638858 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-24aafe80-31ba-44a2-8fc0-0dc3804ad2fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:33.639442 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-24aafe80-31ba-44a2-8fc0-0dc3804ad2fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:33.801591 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-24aafe80-31ba-44a2-8fc0-0dc3804ad2fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:33.810002 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-24aafe80-31ba-44a2-8fc0-0dc3804ad2fd tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1265 microversion: 2.1 time: 0.186842 Oct 06 12:26:33.820099 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 288/582] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:33 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:26:34.277822 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6d99829e-a778-44e2-a599-5bac2d9a59ec tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:34.278525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-6d99829e-a778-44e2-a599-5bac2d9a59ec tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:34.285931 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6d99829e-a778-44e2-a599-5bac2d9a59ec tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:34.286435 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6d99829e-a778-44e2-a599-5bac2d9a59ec tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:34.287083 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6d99829e-a778-44e2-a599-5bac2d9a59ec tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:34.288032 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6d99829e-a778-44e2-a599-5bac2d9a59ec tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:34.288338 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6d99829e-a778-44e2-a599-5bac2d9a59ec tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:34.288793 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6d99829e-a778-44e2-a599-5bac2d9a59ec tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:34.429227 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6d99829e-a778-44e2-a599-5bac2d9a59ec tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:34.437956 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-6d99829e-a778-44e2-a599-5bac2d9a59ec tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1724 microversion: 2.1 time: 0.164893 Oct 06 12:26:34.438533 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 295/583] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:34 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:34.840454 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-860328d1-bc83-4623-abfc-4829ca3d3b46 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:34.841618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-860328d1-bc83-4623-abfc-4829ca3d3b46 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:34.850378 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-860328d1-bc83-4623-abfc-4829ca3d3b46 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:34.850894 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-860328d1-bc83-4623-abfc-4829ca3d3b46 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:34.851324 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-860328d1-bc83-4623-abfc-4829ca3d3b46 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:34.852049 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-860328d1-bc83-4623-abfc-4829ca3d3b46 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:34.852495 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-860328d1-bc83-4623-abfc-4829ca3d3b46 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:34.852910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-860328d1-bc83-4623-abfc-4829ca3d3b46 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:34.877276 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=100 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:34.995681 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-860328d1-bc83-4623-abfc-4829ca3d3b46 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:35.004916 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-860328d1-bc83-4623-abfc-4829ca3d3b46 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1265 microversion: 2.1 time: 0.173460 Oct 06 12:26:35.006295 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 289/584] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:34 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:35.464368 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ae25540e-fc4f-405d-b948-2d2a556d4ad6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:35.466010 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ae25540e-fc4f-405d-b948-2d2a556d4ad6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:35.476971 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae25540e-fc4f-405d-b948-2d2a556d4ad6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:35.477945 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae25540e-fc4f-405d-b948-2d2a556d4ad6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:35.478663 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae25540e-fc4f-405d-b948-2d2a556d4ad6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:35.479441 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae25540e-fc4f-405d-b948-2d2a556d4ad6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:35.480139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae25540e-fc4f-405d-b948-2d2a556d4ad6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:35.481147 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae25540e-fc4f-405d-b948-2d2a556d4ad6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:35.642775 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ae25540e-fc4f-405d-b948-2d2a556d4ad6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:35.651442 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ae25540e-fc4f-405d-b948-2d2a556d4ad6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1724 microversion: 2.1 time: 0.193020 Oct 06 12:26:35.652398 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 296/585] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:35 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:36.028888 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0c60fff1-89bf-413c-bc1f-8f5ee5bb4c7b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:36.029895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0c60fff1-89bf-413c-bc1f-8f5ee5bb4c7b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:36.038375 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0c60fff1-89bf-413c-bc1f-8f5ee5bb4c7b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:36.039155 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0c60fff1-89bf-413c-bc1f-8f5ee5bb4c7b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:36.039827 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0c60fff1-89bf-413c-bc1f-8f5ee5bb4c7b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:36.040776 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0c60fff1-89bf-413c-bc1f-8f5ee5bb4c7b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:36.041423 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0c60fff1-89bf-413c-bc1f-8f5ee5bb4c7b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:36.042062 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0c60fff1-89bf-413c-bc1f-8f5ee5bb4c7b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:36.042855 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-6e166775-86f4-49f0-b76d-98c64510c811 req-8352bb1d-9760-431a-80ca-fa2eb3adb71c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a965adee-462e-4616-9ffe-bcb94e58c7ae", "name": "network-vif-plugged", "status": "completed", "tag": "99d2670f-f58f-45d7-a104-307b021263f0"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:26:36.054998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-6e166775-86f4-49f0-b76d-98c64510c811 req-8352bb1d-9760-431a-80ca-fa2eb3adb71c service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:36.055902 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-6e166775-86f4-49f0-b76d-98c64510c811 req-8352bb1d-9760-431a-80ca-fa2eb3adb71c service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:36.056286 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-6e166775-86f4-49f0-b76d-98c64510c811 req-8352bb1d-9760-431a-80ca-fa2eb3adb71c service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:36.071277 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-6e166775-86f4-49f0-b76d-98c64510c811 req-8352bb1d-9760-431a-80ca-fa2eb3adb71c service nova] Creating event network-vif-plugged:99d2670f-f58f-45d7-a104-307b021263f0 for instance a965adee-462e-4616-9ffe-bcb94e58c7ae on hv-cinder-85604 Oct 06 12:26:36.077549 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-6e166775-86f4-49f0-b76d-98c64510c811 req-8352bb1d-9760-431a-80ca-fa2eb3adb71c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038431 Oct 06 12:26:36.079654 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 297/586] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:26:36.190447 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0c60fff1-89bf-413c-bc1f-8f5ee5bb4c7b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:36.199078 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0c60fff1-89bf-413c-bc1f-8f5ee5bb4c7b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1265 microversion: 2.1 time: 0.175312 Oct 06 12:26:36.200092 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 290/587] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:36 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:36.676561 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-545c0be2-d0db-4ea5-99ea-a97b870a4cb2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:36.677463 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-545c0be2-d0db-4ea5-99ea-a97b870a4cb2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:36.684248 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-545c0be2-d0db-4ea5-99ea-a97b870a4cb2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:36.684935 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-545c0be2-d0db-4ea5-99ea-a97b870a4cb2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:36.685560 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-545c0be2-d0db-4ea5-99ea-a97b870a4cb2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:36.686257 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-545c0be2-d0db-4ea5-99ea-a97b870a4cb2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:36.686770 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-545c0be2-d0db-4ea5-99ea-a97b870a4cb2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:36.687172 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-545c0be2-d0db-4ea5-99ea-a97b870a4cb2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:36.691953 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:36.822299 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-545c0be2-d0db-4ea5-99ea-a97b870a4cb2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:36.830460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-545c0be2-d0db-4ea5-99ea-a97b870a4cb2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1724 microversion: 2.1 time: 0.158313 Oct 06 12:26:36.831028 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 298/588] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:36 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:37.222467 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-1e9a8fe4-b3a0-4b1a-94fd-b51ef8833ff3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:37.223690 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-1e9a8fe4-b3a0-4b1a-94fd-b51ef8833ff3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:37.229938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1e9a8fe4-b3a0-4b1a-94fd-b51ef8833ff3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:37.230561 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1e9a8fe4-b3a0-4b1a-94fd-b51ef8833ff3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:37.230923 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1e9a8fe4-b3a0-4b1a-94fd-b51ef8833ff3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:37.231728 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1e9a8fe4-b3a0-4b1a-94fd-b51ef8833ff3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:37.232170 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1e9a8fe4-b3a0-4b1a-94fd-b51ef8833ff3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:37.232641 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1e9a8fe4-b3a0-4b1a-94fd-b51ef8833ff3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:37.361120 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-1e9a8fe4-b3a0-4b1a-94fd-b51ef8833ff3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:37.369285 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-1e9a8fe4-b3a0-4b1a-94fd-b51ef8833ff3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1265 microversion: 2.1 time: 0.150996 Oct 06 12:26:37.369879 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 291/589] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:37 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:37.854519 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-22f83b95-8aa5-4967-8fa3-c1b0f69981f5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:37.855938 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-22f83b95-8aa5-4967-8fa3-c1b0f69981f5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:37.863806 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22f83b95-8aa5-4967-8fa3-c1b0f69981f5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:37.864398 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22f83b95-8aa5-4967-8fa3-c1b0f69981f5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:37.864910 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22f83b95-8aa5-4967-8fa3-c1b0f69981f5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:37.865636 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22f83b95-8aa5-4967-8fa3-c1b0f69981f5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:37.866152 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22f83b95-8aa5-4967-8fa3-c1b0f69981f5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:37.866527 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22f83b95-8aa5-4967-8fa3-c1b0f69981f5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:38.039286 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-22f83b95-8aa5-4967-8fa3-c1b0f69981f5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:38.048817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-22f83b95-8aa5-4967-8fa3-c1b0f69981f5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1724 microversion: 2.1 time: 0.197860 Oct 06 12:26:38.049788 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 299/590] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:37 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:38.393308 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d05afd26-a975-4b2e-a2d6-4d14d4bf3bd0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:38.394065 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d05afd26-a975-4b2e-a2d6-4d14d4bf3bd0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:38.402018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d05afd26-a975-4b2e-a2d6-4d14d4bf3bd0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:38.402578 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d05afd26-a975-4b2e-a2d6-4d14d4bf3bd0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:38.403442 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d05afd26-a975-4b2e-a2d6-4d14d4bf3bd0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:38.404549 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d05afd26-a975-4b2e-a2d6-4d14d4bf3bd0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:38.405133 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d05afd26-a975-4b2e-a2d6-4d14d4bf3bd0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:38.405681 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d05afd26-a975-4b2e-a2d6-4d14d4bf3bd0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:38.540388 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d05afd26-a975-4b2e-a2d6-4d14d4bf3bd0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:38.547934 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d05afd26-a975-4b2e-a2d6-4d14d4bf3bd0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1265 microversion: 2.1 time: 0.158517 Oct 06 12:26:38.549043 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 292/591] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:38 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:39.073245 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e3bf598d-14fc-4cab-afed-5d907890a695 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:39.073854 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e3bf598d-14fc-4cab-afed-5d907890a695 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:39.080235 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e3bf598d-14fc-4cab-afed-5d907890a695 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:39.080723 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e3bf598d-14fc-4cab-afed-5d907890a695 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:39.081159 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e3bf598d-14fc-4cab-afed-5d907890a695 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:39.081845 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e3bf598d-14fc-4cab-afed-5d907890a695 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:39.082301 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e3bf598d-14fc-4cab-afed-5d907890a695 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:39.082726 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e3bf598d-14fc-4cab-afed-5d907890a695 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:39.207880 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e3bf598d-14fc-4cab-afed-5d907890a695 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:39.215837 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e3bf598d-14fc-4cab-afed-5d907890a695 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1724 microversion: 2.1 time: 0.146399 Oct 06 12:26:39.216401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 300/592] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:39 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:39.572220 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0ac60f8e-c501-4baf-9c7a-521b321728ff tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:39.573575 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0ac60f8e-c501-4baf-9c7a-521b321728ff tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:39.580880 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0ac60f8e-c501-4baf-9c7a-521b321728ff tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:39.581749 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0ac60f8e-c501-4baf-9c7a-521b321728ff tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:39.582201 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0ac60f8e-c501-4baf-9c7a-521b321728ff tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:39.582900 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0ac60f8e-c501-4baf-9c7a-521b321728ff tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:39.583354 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0ac60f8e-c501-4baf-9c7a-521b321728ff tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:39.583827 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0ac60f8e-c501-4baf-9c7a-521b321728ff tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:39.745249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0ac60f8e-c501-4baf-9c7a-521b321728ff tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:39.765655 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0ac60f8e-c501-4baf-9c7a-521b321728ff tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1452 microversion: 2.1 time: 0.186050 Oct 06 12:26:39.767179 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 293/593] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:39 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1452 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:39.786112 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-90141c20-c4eb-4f3f-b07e-70c42fb437f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:39.786702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-90141c20-c4eb-4f3f-b07e-70c42fb437f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:39.792678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-90141c20-c4eb-4f3f-b07e-70c42fb437f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:39.793164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-90141c20-c4eb-4f3f-b07e-70c42fb437f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:39.793973 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-90141c20-c4eb-4f3f-b07e-70c42fb437f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:39.794278 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-90141c20-c4eb-4f3f-b07e-70c42fb437f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:39.794731 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-90141c20-c4eb-4f3f-b07e-70c42fb437f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:39.795154 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-90141c20-c4eb-4f3f-b07e-70c42fb437f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:39.941557 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-90141c20-c4eb-4f3f-b07e-70c42fb437f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:39.949232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-90141c20-c4eb-4f3f-b07e-70c42fb437f5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1452 microversion: 2.1 time: 0.167509 Oct 06 12:26:39.949789 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 301/594] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:39 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:40.239881 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-233496ab-58f7-4931-8702-1cc63b343023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:40.240499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-233496ab-58f7-4931-8702-1cc63b343023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:40.242354 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:40.248006 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-233496ab-58f7-4931-8702-1cc63b343023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:40.248503 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-233496ab-58f7-4931-8702-1cc63b343023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:40.248944 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-233496ab-58f7-4931-8702-1cc63b343023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:40.249639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-233496ab-58f7-4931-8702-1cc63b343023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:40.250096 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-233496ab-58f7-4931-8702-1cc63b343023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:40.250521 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-233496ab-58f7-4931-8702-1cc63b343023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:40.385757 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-233496ab-58f7-4931-8702-1cc63b343023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:40.394535 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-233496ab-58f7-4931-8702-1cc63b343023 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1701 microversion: 2.1 time: 0.158770 Oct 06 12:26:40.395114 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 294/595] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:40 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1701 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:40.419536 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ba35529d-32ce-4695-b231-3b2e92b86f38 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:26:40.426559 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ba35529d-32ce-4695-b231-3b2e92b86f38 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:40.427048 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ba35529d-32ce-4695-b231-3b2e92b86f38 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:40.427483 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ba35529d-32ce-4695-b231-3b2e92b86f38 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:40.449761 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ba35529d-32ce-4695-b231-3b2e92b86f38 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Going to try to start instance {{(pid=120508) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 06 12:26:40.490499 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ba35529d-32ce-4695-b231-3b2e92b86f38 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "POST /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/action" status: 202 len: 0 microversion: 2.1 time: 0.074907 Oct 06 12:26:40.491096 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 302/596] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 12:26:40 2022] POST /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:26:40.499063 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0d715e9b-5453-4eb1-a0b3-5005a79e547b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:40.499691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0d715e9b-5453-4eb1-a0b3-5005a79e547b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:40.505964 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0d715e9b-5453-4eb1-a0b3-5005a79e547b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:40.506441 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0d715e9b-5453-4eb1-a0b3-5005a79e547b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:40.506871 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0d715e9b-5453-4eb1-a0b3-5005a79e547b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:40.507587 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0d715e9b-5453-4eb1-a0b3-5005a79e547b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:40.508239 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0d715e9b-5453-4eb1-a0b3-5005a79e547b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:40.508654 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0d715e9b-5453-4eb1-a0b3-5005a79e547b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:40.648560 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0d715e9b-5453-4eb1-a0b3-5005a79e547b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:40.657132 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0d715e9b-5453-4eb1-a0b3-5005a79e547b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1710 microversion: 2.1 time: 0.161843 Oct 06 12:26:40.657710 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 295/597] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:40 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:41.682002 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-005dac3b-9ca6-4f9c-b1ae-d2e5b5198dcf tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:41.682780 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-005dac3b-9ca6-4f9c-b1ae-d2e5b5198dcf tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:41.690636 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-005dac3b-9ca6-4f9c-b1ae-d2e5b5198dcf tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:41.691538 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-005dac3b-9ca6-4f9c-b1ae-d2e5b5198dcf tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:41.692126 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-005dac3b-9ca6-4f9c-b1ae-d2e5b5198dcf tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:41.693013 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-005dac3b-9ca6-4f9c-b1ae-d2e5b5198dcf tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:41.693644 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-005dac3b-9ca6-4f9c-b1ae-d2e5b5198dcf tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:41.694235 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-005dac3b-9ca6-4f9c-b1ae-d2e5b5198dcf tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:41.838938 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-005dac3b-9ca6-4f9c-b1ae-d2e5b5198dcf tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:41.847897 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-005dac3b-9ca6-4f9c-b1ae-d2e5b5198dcf tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1710 microversion: 2.1 time: 0.171811 Oct 06 12:26:41.848575 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 303/598] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:41 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1710 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:42.309234 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-9e00806c-67f3-4aa4-b04b-d6deb36f0565 req-970c0a1c-39c7-4a65-9215-d4847fa57807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a965adee-462e-4616-9ffe-bcb94e58c7ae", "tag": "99d2670f-f58f-45d7-a104-307b021263f0"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:26:42.315489 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=72 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:42.322961 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-9e00806c-67f3-4aa4-b04b-d6deb36f0565 req-970c0a1c-39c7-4a65-9215-d4847fa57807 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:42.323630 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-9e00806c-67f3-4aa4-b04b-d6deb36f0565 req-970c0a1c-39c7-4a65-9215-d4847fa57807 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:42.324409 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-9e00806c-67f3-4aa4-b04b-d6deb36f0565 req-970c0a1c-39c7-4a65-9215-d4847fa57807 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:42.336508 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-9e00806c-67f3-4aa4-b04b-d6deb36f0565 req-970c0a1c-39c7-4a65-9215-d4847fa57807 service nova] Creating event network-changed:99d2670f-f58f-45d7-a104-307b021263f0 for instance a965adee-462e-4616-9ffe-bcb94e58c7ae on hv-cinder-85604 Oct 06 12:26:42.341669 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-9e00806c-67f3-4aa4-b04b-d6deb36f0565 req-970c0a1c-39c7-4a65-9215-d4847fa57807 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037162 Oct 06 12:26:42.343630 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 296/599] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:26:42.391075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1882beee-e220-493e-8d0c-68ff5726b5c6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:42.391972 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-1882beee-e220-493e-8d0c-68ff5726b5c6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:42.398099 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1882beee-e220-493e-8d0c-68ff5726b5c6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:42.398725 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1882beee-e220-493e-8d0c-68ff5726b5c6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:42.399261 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1882beee-e220-493e-8d0c-68ff5726b5c6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:42.400192 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1882beee-e220-493e-8d0c-68ff5726b5c6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:42.400769 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1882beee-e220-493e-8d0c-68ff5726b5c6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:42.401291 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1882beee-e220-493e-8d0c-68ff5726b5c6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:42.536706 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-1882beee-e220-493e-8d0c-68ff5726b5c6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:42.544947 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-1882beee-e220-493e-8d0c-68ff5726b5c6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1595 microversion: 2.1 time: 0.158115 Oct 06 12:26:42.545524 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 304/600] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:42 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:42.873470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-491d987d-4936-45ce-94c3-0248fb9745bb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:42.874182 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-491d987d-4936-45ce-94c3-0248fb9745bb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:42.880861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-491d987d-4936-45ce-94c3-0248fb9745bb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:42.881531 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-491d987d-4936-45ce-94c3-0248fb9745bb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:42.882167 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-491d987d-4936-45ce-94c3-0248fb9745bb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:42.883017 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-491d987d-4936-45ce-94c3-0248fb9745bb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:42.883671 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-491d987d-4936-45ce-94c3-0248fb9745bb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:42.884270 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-491d987d-4936-45ce-94c3-0248fb9745bb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:43.427138 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-491d987d-4936-45ce-94c3-0248fb9745bb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:43.439040 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-491d987d-4936-45ce-94c3-0248fb9745bb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1710 microversion: 2.1 time: 0.570514 Oct 06 12:26:43.456270 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 297/601] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:42 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1710 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:44.464287 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c19326d0-bb31-472e-bf4f-7514a6523fb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:44.464899 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c19326d0-bb31-472e-bf4f-7514a6523fb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:44.467619 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=68 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:44.474414 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c19326d0-bb31-472e-bf4f-7514a6523fb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:44.475245 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c19326d0-bb31-472e-bf4f-7514a6523fb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:44.475819 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c19326d0-bb31-472e-bf4f-7514a6523fb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:44.476648 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c19326d0-bb31-472e-bf4f-7514a6523fb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:44.477324 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c19326d0-bb31-472e-bf4f-7514a6523fb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:44.478130 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c19326d0-bb31-472e-bf4f-7514a6523fb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:44.697669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c19326d0-bb31-472e-bf4f-7514a6523fb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:44.706190 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c19326d0-bb31-472e-bf4f-7514a6523fb4 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1714 microversion: 2.1 time: 0.245947 Oct 06 12:26:44.706779 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 305/602] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:44 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1714 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:44.970623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-7ec0faaf-3c6f-4825-b332-3f0672b72c07 req-5b10efd2-cdff-4fd0-bdba-a24f3d3cff2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb42d057-804d-4d87-953a-953bf69fe126", "tag": "9a4b9943-b074-4a4d-a9c2-a11438741a56"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:26:44.985588 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-7ec0faaf-3c6f-4825-b332-3f0672b72c07 req-5b10efd2-cdff-4fd0-bdba-a24f3d3cff2e service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:44.986453 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-7ec0faaf-3c6f-4825-b332-3f0672b72c07 req-5b10efd2-cdff-4fd0-bdba-a24f3d3cff2e service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:44.986977 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-7ec0faaf-3c6f-4825-b332-3f0672b72c07 req-5b10efd2-cdff-4fd0-bdba-a24f3d3cff2e service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:44.998793 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-7ec0faaf-3c6f-4825-b332-3f0672b72c07 req-5b10efd2-cdff-4fd0-bdba-a24f3d3cff2e service nova] Creating event network-changed:9a4b9943-b074-4a4d-a9c2-a11438741a56 for instance eb42d057-804d-4d87-953a-953bf69fe126 on hv-cinder-85604 Oct 06 12:26:45.004038 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-7ec0faaf-3c6f-4825-b332-3f0672b72c07 req-5b10efd2-cdff-4fd0-bdba-a24f3d3cff2e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038739 Oct 06 12:26:45.004814 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 298/603] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:26:46.139947 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b2860471-45b4-4437-ab8b-0c2a021bbcb0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1981812851"}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:26:46.140485 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b2860471-45b4-4437-ab8b-0c2a021bbcb0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:46.147965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b2860471-45b4-4437-ab8b-0c2a021bbcb0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:46.148484 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b2860471-45b4-4437-ab8b-0c2a021bbcb0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:46.149132 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b2860471-45b4-4437-ab8b-0c2a021bbcb0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:46.149840 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b2860471-45b4-4437-ab8b-0c2a021bbcb0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:46.150316 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b2860471-45b4-4437-ab8b-0c2a021bbcb0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:46.150741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b2860471-45b4-4437-ab8b-0c2a021bbcb0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:46.279859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.network.security_group_api [None req-b2860471-45b4-4437-ab8b-0c2a021bbcb0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Adding security group 950d9b58-485d-4fdd-98f4-f02892e128cf to port 9a4b9943-b074-4a4d-a9c2-a11438741a56 Oct 06 12:26:46.583495 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b2860471-45b4-4437-ab8b-0c2a021bbcb0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "POST /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/action" status: 202 len: 0 microversion: 2.1 time: 0.447783 Oct 06 12:26:46.584155 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 306/604] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 12:26:46 2022] POST /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:26:46.593011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3aff1aa8-5959-4f0a-b912-ccc9b56b082e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:26:46.593715 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3aff1aa8-5959-4f0a-b912-ccc9b56b082e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:46.599831 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3aff1aa8-5959-4f0a-b912-ccc9b56b082e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:46.600317 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3aff1aa8-5959-4f0a-b912-ccc9b56b082e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:46.600765 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3aff1aa8-5959-4f0a-b912-ccc9b56b082e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:46.601455 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3aff1aa8-5959-4f0a-b912-ccc9b56b082e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:46.601908 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3aff1aa8-5959-4f0a-b912-ccc9b56b082e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:46.602330 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3aff1aa8-5959-4f0a-b912-ccc9b56b082e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:46.748243 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3aff1aa8-5959-4f0a-b912-ccc9b56b082e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:26:46.756454 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3aff1aa8-5959-4f0a-b912-ccc9b56b082e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1761 microversion: 2.1 time: 0.167785 Oct 06 12:26:46.757033 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 299/605] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:26:46 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1761 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:26:47.021638 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-b10227c8-9227-4efe-b4f6-38f16183fe68 req-ac84e8be-5bda-441a-adba-9292d1f4a9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb42d057-804d-4d87-953a-953bf69fe126", "tag": "9a4b9943-b074-4a4d-a9c2-a11438741a56"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:26:47.031260 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-b10227c8-9227-4efe-b4f6-38f16183fe68 req-ac84e8be-5bda-441a-adba-9292d1f4a9a8 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:47.032364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-b10227c8-9227-4efe-b4f6-38f16183fe68 req-ac84e8be-5bda-441a-adba-9292d1f4a9a8 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:47.032835 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-b10227c8-9227-4efe-b4f6-38f16183fe68 req-ac84e8be-5bda-441a-adba-9292d1f4a9a8 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:47.043806 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-b10227c8-9227-4efe-b4f6-38f16183fe68 req-ac84e8be-5bda-441a-adba-9292d1f4a9a8 service nova] Creating event network-changed:9a4b9943-b074-4a4d-a9c2-a11438741a56 for instance eb42d057-804d-4d87-953a-953bf69fe126 on hv-cinder-85604 Oct 06 12:26:47.049476 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-b10227c8-9227-4efe-b4f6-38f16183fe68 req-ac84e8be-5bda-441a-adba-9292d1f4a9a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031605 Oct 06 12:26:47.050440 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 307/606] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:26:51.456871 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-854a9fb4-ae20-4c43-b896-7e0548e1fd50 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efaab87a-8022-476e-b295-f4d6b7cc57ae", "device": "/dev/sdb"}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:26:51.459877 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-854a9fb4-ae20-4c43-b896-7e0548e1fd50 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:26:51.466123 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-854a9fb4-ae20-4c43-b896-7e0548e1fd50 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:51.466600 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-854a9fb4-ae20-4c43-b896-7e0548e1fd50 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:51.467029 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-854a9fb4-ae20-4c43-b896-7e0548e1fd50 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:51.467737 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-854a9fb4-ae20-4c43-b896-7e0548e1fd50 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:26:51.468190 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-854a9fb4-ae20-4c43-b896-7e0548e1fd50 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:26:51.468612 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-854a9fb4-ae20-4c43-b896-7e0548e1fd50 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:26:51.762648 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-854a9fb4-ae20-4c43-b896-7e0548e1fd50 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "POST /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309576 Oct 06 12:26:51.763266 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 300/607] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 12:26:51 2022] POST /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:27:21.611619 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=5 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:21.612483 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:21.617367 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-28f06f62-01c4-4a4f-a160-c885fada8dcc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:21.617977 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-28f06f62-01c4-4a4f-a160-c885fada8dcc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:21.625242 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28f06f62-01c4-4a4f-a160-c885fada8dcc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:21.625719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28f06f62-01c4-4a4f-a160-c885fada8dcc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:21.626153 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28f06f62-01c4-4a4f-a160-c885fada8dcc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:21.626932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28f06f62-01c4-4a4f-a160-c885fada8dcc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:21.627393 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28f06f62-01c4-4a4f-a160-c885fada8dcc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:21.627850 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28f06f62-01c4-4a4f-a160-c885fada8dcc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:21.945561 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-28f06f62-01c4-4a4f-a160-c885fada8dcc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lazy-loading 'services' on Instance uuid 6fc250a5-1327-420b-bb97-d216396d2b73 {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:27:22.058790 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-28f06f62-01c4-4a4f-a160-c885fada8dcc tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73/os-volume_attachments/efaab87a-8022-476e-b295-f4d6b7cc57ae" status: 202 len: 0 microversion: 2.1 time: 0.448714 Oct 06 12:27:22.059387 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 308/608] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 12:27:21 2022] DELETE /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73/os-volume_attachments/efaab87a-8022-476e-b295-f4d6b7cc57ae => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:27:23.181065 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=9 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:23.181907 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:23.186361 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-784352b7-4455-4d11-937c-5d224e64eef6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:23.187014 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-784352b7-4455-4d11-937c-5d224e64eef6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:23.194473 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-784352b7-4455-4d11-937c-5d224e64eef6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:23.195207 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-784352b7-4455-4d11-937c-5d224e64eef6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:23.195737 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-784352b7-4455-4d11-937c-5d224e64eef6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:23.196508 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-784352b7-4455-4d11-937c-5d224e64eef6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:23.197042 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-784352b7-4455-4d11-937c-5d224e64eef6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:23.197513 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-784352b7-4455-4d11-937c-5d224e64eef6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:23.224136 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-784352b7-4455-4d11-937c-5d224e64eef6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Going to try to terminate instance {{(pid=120509) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:27:23.296224 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-784352b7-4455-4d11-937c-5d224e64eef6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 204 len: 0 microversion: 2.1 time: 0.116455 Oct 06 12:27:23.297107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 301/609] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:27:23 2022] DELETE /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:27:23.306284 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0708a31c-b7da-46a2-9b71-999217853f19 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:23.307025 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-0708a31c-b7da-46a2-9b71-999217853f19 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:23.313094 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0708a31c-b7da-46a2-9b71-999217853f19 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:23.313583 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0708a31c-b7da-46a2-9b71-999217853f19 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:23.314019 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0708a31c-b7da-46a2-9b71-999217853f19 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:23.314712 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0708a31c-b7da-46a2-9b71-999217853f19 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:23.315170 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0708a31c-b7da-46a2-9b71-999217853f19 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:23.315630 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0708a31c-b7da-46a2-9b71-999217853f19 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:23.443237 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-0708a31c-b7da-46a2-9b71-999217853f19 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:23.450934 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-0708a31c-b7da-46a2-9b71-999217853f19 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1512 microversion: 2.1 time: 0.149525 Oct 06 12:27:23.451497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 309/610] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:23 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:27:24.474854 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-fbd7eb2c-980e-49d6-9d3c-5c7a999e4c84 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:24.475595 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-fbd7eb2c-980e-49d6-9d3c-5c7a999e4c84 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:24.482089 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbd7eb2c-980e-49d6-9d3c-5c7a999e4c84 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:24.482571 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbd7eb2c-980e-49d6-9d3c-5c7a999e4c84 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:24.483307 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbd7eb2c-980e-49d6-9d3c-5c7a999e4c84 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:24.484055 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbd7eb2c-980e-49d6-9d3c-5c7a999e4c84 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:24.484505 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbd7eb2c-980e-49d6-9d3c-5c7a999e4c84 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:24.484925 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbd7eb2c-980e-49d6-9d3c-5c7a999e4c84 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:24.710513 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fbd7eb2c-980e-49d6-9d3c-5c7a999e4c84 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:24.717995 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-fbd7eb2c-980e-49d6-9d3c-5c7a999e4c84 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1512 microversion: 2.1 time: 0.247860 Oct 06 12:27:24.718557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 302/611] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:24 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:27:25.741144 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f304e962-493c-4385-b318-c82e5992e44b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:25.741757 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f304e962-493c-4385-b318-c82e5992e44b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:25.748158 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f304e962-493c-4385-b318-c82e5992e44b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:25.748638 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f304e962-493c-4385-b318-c82e5992e44b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:25.749069 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f304e962-493c-4385-b318-c82e5992e44b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:25.749760 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f304e962-493c-4385-b318-c82e5992e44b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:25.750213 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f304e962-493c-4385-b318-c82e5992e44b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:25.750634 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f304e962-493c-4385-b318-c82e5992e44b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:25.876767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f304e962-493c-4385-b318-c82e5992e44b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:25.884477 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f304e962-493c-4385-b318-c82e5992e44b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1512 microversion: 2.1 time: 0.147166 Oct 06 12:27:25.885051 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 310/612] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:25 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:27:26.221702 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-8d0b4739-7826-49f2-adea-cdf6c117e83c req-1849eccd-6b7f-4f14-bf12-d5b23e4c8868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fc250a5-1327-420b-bb97-d216396d2b73", "name": "network-vif-deleted", "tag": "a780075c-a2ca-45cd-b0e5-d55fa7367adc"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:27:26.231847 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-8d0b4739-7826-49f2-adea-cdf6c117e83c req-1849eccd-6b7f-4f14-bf12-d5b23e4c8868 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:26.232316 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-8d0b4739-7826-49f2-adea-cdf6c117e83c req-1849eccd-6b7f-4f14-bf12-d5b23e4c8868 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:26.232738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-8d0b4739-7826-49f2-adea-cdf6c117e83c req-1849eccd-6b7f-4f14-bf12-d5b23e4c8868 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:26.244391 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-8d0b4739-7826-49f2-adea-cdf6c117e83c req-1849eccd-6b7f-4f14-bf12-d5b23e4c8868 service nova] Creating event network-vif-deleted:a780075c-a2ca-45cd-b0e5-d55fa7367adc for instance 6fc250a5-1327-420b-bb97-d216396d2b73 on hv-cinder-85604 Oct 06 12:27:26.249574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-8d0b4739-7826-49f2-adea-cdf6c117e83c req-1849eccd-6b7f-4f14-bf12-d5b23e4c8868 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031512 Oct 06 12:27:26.250516 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 303/613] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:27:26.908008 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3eff3aaf-151d-4073-b095-3cb4ecdfc313 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:26.908613 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3eff3aaf-151d-4073-b095-3cb4ecdfc313 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:26.910937 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 12:27:26.911083 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Thu Oct 6 12:27:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 (ip 10.222.0.33) !!! Oct 06 12:27:26.919607 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3eff3aaf-151d-4073-b095-3cb4ecdfc313 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:26.920127 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3eff3aaf-151d-4073-b095-3cb4ecdfc313 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:26.920567 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3eff3aaf-151d-4073-b095-3cb4ecdfc313 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:26.921263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3eff3aaf-151d-4073-b095-3cb4ecdfc313 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:26.921725 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3eff3aaf-151d-4073-b095-3cb4ecdfc313 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:26.922153 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3eff3aaf-151d-4073-b095-3cb4ecdfc313 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:26.955341 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3eff3aaf-151d-4073-b095-3cb4ecdfc313 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:26.955871 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3eff3aaf-151d-4073-b095-3cb4ecdfc313 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:26.956314 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3eff3aaf-151d-4073-b095-3cb4ecdfc313 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:26.956759 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-3eff3aaf-151d-4073-b095-3cb4ecdfc313 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lazy-loading 'fault' on Instance uuid 6fc250a5-1327-420b-bb97-d216396d2b73 {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:27:26.996675 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3eff3aaf-151d-4073-b095-3cb4ecdfc313 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:27.005161 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3eff3aaf-151d-4073-b095-3cb4ecdfc313 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 200 len: 1308 microversion: 2.1 time: 0.100969 Oct 06 12:27:27.005739 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 311/614] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:26 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:27:28.028925 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8af7cc2e-7240-4221-9e4d-c1dc97a1630b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:28.029618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8af7cc2e-7240-4221-9e4d-c1dc97a1630b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 6fc250a5-1327-420b-bb97-d216396d2b73] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:28.036710 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8af7cc2e-7240-4221-9e4d-c1dc97a1630b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:28.037190 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8af7cc2e-7240-4221-9e4d-c1dc97a1630b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:28.037619 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8af7cc2e-7240-4221-9e4d-c1dc97a1630b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:28.038297 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8af7cc2e-7240-4221-9e4d-c1dc97a1630b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:28.038742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8af7cc2e-7240-4221-9e4d-c1dc97a1630b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:28.039159 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8af7cc2e-7240-4221-9e4d-c1dc97a1630b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:28.052019 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-8af7cc2e-7240-4221-9e4d-c1dc97a1630b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] HTTP exception thrown: Instance 6fc250a5-1327-420b-bb97-d216396d2b73 could not be found. Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8af7cc2e-7240-4221-9e4d-c1dc97a1630b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Request method failure captured: Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 HTTP/1.1 Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsk7uTBosX3bFps59UNuz_cinkvq608C1__DTsQ_ls7hbvkR6zvhekvy7ToOsYfVPnjJbJnRMX869CyUNqNA3FyjWJRZnb8oAV65qVXbsxxMY3WU2ioEbp-DJkILtSVUOiHCwUF27j4u48DF_yDIPygUGh1DtB-bs1l2C2SWmMo_XK0 Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: d2d5034a312544cd9a1d72439556cf41 Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-VolumesSnapshotTestJSON-912460753 Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:27:28.053592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:27:28.055103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2d5034a312544cd9a1d72439556cf41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d2d5034a312544cd9a1d72439556cf41", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2d5034a312544cd9a1d72439556cf41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d2d5034a312544cd9a1d72439556cf41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:27:28.055103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-VolumesSnapshotTestJSON-912460753 Oct 06 12:27:28.055103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: d2d5034a312544cd9a1d72439556cf41 Oct 06 12:27:28.055103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-912460753 Oct 06 12:27:28.055103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-VolumesSnapshotTestJSON-912460753-project Oct 06 12:27:28.055103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:27:28.055103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:27:28.055103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 7e650801308e4a79b259e239831491e3 Oct 06 12:27:28.055103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-VolumesSnapshotTestJSON-912460753-project Oct 06 12:27:28.055103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:27:28.055103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 6fc250a5-1327-420b-bb97-d216396d2b73 could not be found. Oct 06 12:27:28.055103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '6fc250a5-1327-420b-bb97-d216396d2b73'} Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fc250a5-1327-420b-bb97-d216396d2b73 could not be found. Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:27:28.056011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fc250a5-1327-420b-bb97-d216396d2b73 could not be found. Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fc250a5-1327-420b-bb97-d216396d2b73 could not be found. Oct 06 12:27:28.057642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:27:28.059422 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8af7cc2e-7240-4221-9e4d-c1dc97a1630b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Returning 404 to user: Instance 6fc250a5-1327-420b-bb97-d216396d2b73 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:27:28.059422 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8af7cc2e-7240-4221-9e4d-c1dc97a1630b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73" status: 404 len: 111 microversion: 2.1 time: 0.030966 Oct 06 12:27:28.059422 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 304/615] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:28 2022] GET /compute/v2.1/servers/6fc250a5-1327-420b-bb97-d216396d2b73 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:27:38.097589 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-fcdc3007-e2d3-4b84-862a-d850a44ff51e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:38.098151 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-fcdc3007-e2d3-4b84-862a-d850a44ff51e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:38.100914 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=10 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:38.101578 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:38.107263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fcdc3007-e2d3-4b84-862a-d850a44ff51e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:38.107783 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fcdc3007-e2d3-4b84-862a-d850a44ff51e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:38.108228 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fcdc3007-e2d3-4b84-862a-d850a44ff51e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:38.108929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fcdc3007-e2d3-4b84-862a-d850a44ff51e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:38.109394 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fcdc3007-e2d3-4b84-862a-d850a44ff51e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:38.109826 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fcdc3007-e2d3-4b84-862a-d850a44ff51e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:38.134934 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-fcdc3007-e2d3-4b84-862a-d850a44ff51e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/ips" status: 200 len: 151 microversion: 2.20 time: 0.041840 Oct 06 12:27:38.135528 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 312/616] 10.222.0.33 () {60 vars in 1289 bytes} [Thu Oct 6 12:27:38 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:27:39.988018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1962183673", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "networks": [{"uuid": "11dfbbc8-d8d2-470b-88d8-288b0ef74b7b"}]}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:27:39.997186 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:39.997854 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:40.046732 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.network.neutron [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] validate_networks() for [('11dfbbc8-d8d2-470b-88d8-288b0ef74b7b', None, None, None, None, None)] {{(pid=120509) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:27:40.426969 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Flavor limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:27:40.427383 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Image limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:27:40.427890 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Flavor pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:27:40.428291 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Image pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:27:40.428723 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:27:40.437147 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:40.437621 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:40.438566 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:40.439271 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:40.439750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:40.440168 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:40.456626 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Getting quotas for project d2d5034a312544cd9a1d72439556cf41. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:27:40.460432 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Getting quotas for user 7e650801308e4a79b259e239831491e3 and project d2d5034a312544cd9a1d72439556cf41. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:27:40.470805 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Going to run 1 instances... {{(pid=120509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:27:40.473071 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:27:40.517254 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a59b0b05-9259-430b-b48e-034952997f80 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533679 Oct 06 12:27:40.518048 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 305/617] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:27:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:27:40.529471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-849b7cb6-9dde-4afa-8986-39926db16f7f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:40.530956 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-849b7cb6-9dde-4afa-8986-39926db16f7f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:40.592124 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-849b7cb6-9dde-4afa-8986-39926db16f7f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:40.598890 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-849b7cb6-9dde-4afa-8986-39926db16f7f tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1219 microversion: 2.1 time: 0.073880 Oct 06 12:27:40.599456 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 313/618] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:40 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:27:41.107440 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-fe9fbbaa-e465-49f7-8657-9ee4bc57de99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:27:41.108136 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-fe9fbbaa-e465-49f7-8657-9ee4bc57de99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:41.115590 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe9fbbaa-e465-49f7-8657-9ee4bc57de99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:41.116073 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe9fbbaa-e465-49f7-8657-9ee4bc57de99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:41.116508 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe9fbbaa-e465-49f7-8657-9ee4bc57de99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:41.117319 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe9fbbaa-e465-49f7-8657-9ee4bc57de99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:41.117782 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe9fbbaa-e465-49f7-8657-9ee4bc57de99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:41.118189 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe9fbbaa-e465-49f7-8657-9ee4bc57de99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:41.143399 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-fe9fbbaa-e465-49f7-8657-9ee4bc57de99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lazy-loading 'flavor' on Instance uuid 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:27:41.340191 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-fe9fbbaa-e465-49f7-8657-9ee4bc57de99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "POST /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/action" status: 202 len: 0 microversion: 2.20 time: 0.237340 Oct 06 12:27:41.341035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 306/619] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Oct 6 12:27:41 2022] POST /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:27:41.349746 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e11a3855-3499-46cf-9f80-f683b183bef5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:41.350399 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e11a3855-3499-46cf-9f80-f683b183bef5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:41.356638 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e11a3855-3499-46cf-9f80-f683b183bef5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:41.357409 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e11a3855-3499-46cf-9f80-f683b183bef5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:41.357810 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e11a3855-3499-46cf-9f80-f683b183bef5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:41.358539 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e11a3855-3499-46cf-9f80-f683b183bef5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:41.359000 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e11a3855-3499-46cf-9f80-f683b183bef5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:41.359457 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e11a3855-3499-46cf-9f80-f683b183bef5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:41.490615 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e11a3855-3499-46cf-9f80-f683b183bef5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:41.498571 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e11a3855-3499-46cf-9f80-f683b183bef5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:41.500069 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e11a3855-3499-46cf-9f80-f683b183bef5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:41.501222 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e11a3855-3499-46cf-9f80-f683b183bef5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1721 microversion: 2.20 time: 0.155469 Oct 06 12:27:41.501776 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 314/620] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:41 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:27:41.621220 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-963a3c6d-ac6f-4adc-ae19-850031fab8d4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:41.621909 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-963a3c6d-ac6f-4adc-ae19-850031fab8d4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:41.628245 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-963a3c6d-ac6f-4adc-ae19-850031fab8d4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:41.628722 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-963a3c6d-ac6f-4adc-ae19-850031fab8d4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:41.629150 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-963a3c6d-ac6f-4adc-ae19-850031fab8d4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:41.629837 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-963a3c6d-ac6f-4adc-ae19-850031fab8d4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:41.630394 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-963a3c6d-ac6f-4adc-ae19-850031fab8d4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:41.630868 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-963a3c6d-ac6f-4adc-ae19-850031fab8d4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:41.694320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-963a3c6d-ac6f-4adc-ae19-850031fab8d4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:41.701994 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-963a3c6d-ac6f-4adc-ae19-850031fab8d4 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1271 microversion: 2.1 time: 0.084933 Oct 06 12:27:41.702552 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 307/621] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:41 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:27:42.526273 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-378ba7e4-3e50-482c-9aca-825a5114eb3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:42.526871 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-378ba7e4-3e50-482c-9aca-825a5114eb3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:42.533925 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-378ba7e4-3e50-482c-9aca-825a5114eb3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:42.534782 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-378ba7e4-3e50-482c-9aca-825a5114eb3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:42.535224 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-378ba7e4-3e50-482c-9aca-825a5114eb3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:42.535962 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-378ba7e4-3e50-482c-9aca-825a5114eb3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:42.536420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-378ba7e4-3e50-482c-9aca-825a5114eb3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:42.536852 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-378ba7e4-3e50-482c-9aca-825a5114eb3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:42.666746 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-378ba7e4-3e50-482c-9aca-825a5114eb3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:42.675564 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-378ba7e4-3e50-482c-9aca-825a5114eb3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:42.677295 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-378ba7e4-3e50-482c-9aca-825a5114eb3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:42.678634 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-378ba7e4-3e50-482c-9aca-825a5114eb3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1721 microversion: 2.20 time: 0.156318 Oct 06 12:27:42.679199 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 315/622] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:42 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:27:42.725358 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b96f7f65-5547-4a2b-b61b-7710ddd5e1ea tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:42.725972 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b96f7f65-5547-4a2b-b61b-7710ddd5e1ea tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:42.732436 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b96f7f65-5547-4a2b-b61b-7710ddd5e1ea tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:42.732922 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b96f7f65-5547-4a2b-b61b-7710ddd5e1ea tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:42.733355 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b96f7f65-5547-4a2b-b61b-7710ddd5e1ea tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:42.734039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b96f7f65-5547-4a2b-b61b-7710ddd5e1ea tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:42.734519 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b96f7f65-5547-4a2b-b61b-7710ddd5e1ea tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:42.735474 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b96f7f65-5547-4a2b-b61b-7710ddd5e1ea tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:42.863948 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b96f7f65-5547-4a2b-b61b-7710ddd5e1ea tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:42.871387 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b96f7f65-5547-4a2b-b61b-7710ddd5e1ea tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1319 microversion: 2.1 time: 0.149973 Oct 06 12:27:42.871976 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 308/623] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:42 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:27:43.501572 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-cd0115cf-fe2c-411f-9fe3-b492a3d5cbcb req-0ba6308b-48ec-4a70-aeb5-e6dbcc6cc967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7438f9d0-89d0-430c-81bf-867fae34aa5c", "tag": "9419d7e0-c232-4196-aa32-65d6bd3e5076"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:27:43.511858 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-cd0115cf-fe2c-411f-9fe3-b492a3d5cbcb req-0ba6308b-48ec-4a70-aeb5-e6dbcc6cc967 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:43.512370 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-cd0115cf-fe2c-411f-9fe3-b492a3d5cbcb req-0ba6308b-48ec-4a70-aeb5-e6dbcc6cc967 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:43.512769 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-cd0115cf-fe2c-411f-9fe3-b492a3d5cbcb req-0ba6308b-48ec-4a70-aeb5-e6dbcc6cc967 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:43.526208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-cd0115cf-fe2c-411f-9fe3-b492a3d5cbcb req-0ba6308b-48ec-4a70-aeb5-e6dbcc6cc967 service nova] Creating event network-changed:9419d7e0-c232-4196-aa32-65d6bd3e5076 for instance 7438f9d0-89d0-430c-81bf-867fae34aa5c on hv-cinder-85604 Oct 06 12:27:43.531329 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-cd0115cf-fe2c-411f-9fe3-b492a3d5cbcb req-0ba6308b-48ec-4a70-aeb5-e6dbcc6cc967 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034011 Oct 06 12:27:43.532647 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 316/624] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:27:43.703805 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ec651285-6fc5-4c39-b9da-b31f0c1d172c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:43.704407 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ec651285-6fc5-4c39-b9da-b31f0c1d172c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:43.710243 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec651285-6fc5-4c39-b9da-b31f0c1d172c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:43.710727 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec651285-6fc5-4c39-b9da-b31f0c1d172c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:43.711156 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec651285-6fc5-4c39-b9da-b31f0c1d172c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:43.711872 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec651285-6fc5-4c39-b9da-b31f0c1d172c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:43.712324 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec651285-6fc5-4c39-b9da-b31f0c1d172c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:43.712743 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec651285-6fc5-4c39-b9da-b31f0c1d172c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:43.839895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ec651285-6fc5-4c39-b9da-b31f0c1d172c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:43.849131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ec651285-6fc5-4c39-b9da-b31f0c1d172c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:43.850626 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ec651285-6fc5-4c39-b9da-b31f0c1d172c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:43.851818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ec651285-6fc5-4c39-b9da-b31f0c1d172c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1721 microversion: 2.20 time: 0.152035 Oct 06 12:27:43.852385 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 309/625] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:43 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:27:43.894591 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-87443f61-1e5b-4a57-998c-bfc784f1430b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:43.895296 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-87443f61-1e5b-4a57-998c-bfc784f1430b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:43.901268 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-87443f61-1e5b-4a57-998c-bfc784f1430b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:43.901755 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-87443f61-1e5b-4a57-998c-bfc784f1430b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:43.902443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-87443f61-1e5b-4a57-998c-bfc784f1430b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:43.903746 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-87443f61-1e5b-4a57-998c-bfc784f1430b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:43.904216 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-87443f61-1e5b-4a57-998c-bfc784f1430b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:43.904646 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-87443f61-1e5b-4a57-998c-bfc784f1430b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:44.033916 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-87443f61-1e5b-4a57-998c-bfc784f1430b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:44.041659 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-87443f61-1e5b-4a57-998c-bfc784f1430b tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1319 microversion: 2.1 time: 0.151685 Oct 06 12:27:44.042276 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 317/626] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:43 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:27:44.877219 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d138661f-ab60-4d4f-9f99-ac38e04ac660 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:44.877836 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d138661f-ab60-4d4f-9f99-ac38e04ac660 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:44.884306 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d138661f-ab60-4d4f-9f99-ac38e04ac660 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:44.884794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d138661f-ab60-4d4f-9f99-ac38e04ac660 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:44.885233 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d138661f-ab60-4d4f-9f99-ac38e04ac660 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:44.885921 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d138661f-ab60-4d4f-9f99-ac38e04ac660 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:44.886374 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d138661f-ab60-4d4f-9f99-ac38e04ac660 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:44.886798 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d138661f-ab60-4d4f-9f99-ac38e04ac660 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:45.011272 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d138661f-ab60-4d4f-9f99-ac38e04ac660 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:45.019305 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d138661f-ab60-4d4f-9f99-ac38e04ac660 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:45.020791 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d138661f-ab60-4d4f-9f99-ac38e04ac660 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:45.021929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d138661f-ab60-4d4f-9f99-ac38e04ac660 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1721 microversion: 2.20 time: 0.148721 Oct 06 12:27:45.022483 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 310/627] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:44 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:27:45.063872 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0b14ae80-9a5c-4298-ac76-08d916605daf tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:45.064539 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-0b14ae80-9a5c-4298-ac76-08d916605daf tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:45.070588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0b14ae80-9a5c-4298-ac76-08d916605daf tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:45.071063 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0b14ae80-9a5c-4298-ac76-08d916605daf tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:45.071490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0b14ae80-9a5c-4298-ac76-08d916605daf tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:45.072194 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0b14ae80-9a5c-4298-ac76-08d916605daf tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:45.072644 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0b14ae80-9a5c-4298-ac76-08d916605daf tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:45.073063 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0b14ae80-9a5c-4298-ac76-08d916605daf tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:45.198561 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-0b14ae80-9a5c-4298-ac76-08d916605daf tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:45.206024 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-0b14ae80-9a5c-4298-ac76-08d916605daf tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1319 microversion: 2.1 time: 0.145934 Oct 06 12:27:45.206581 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 318/628] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:45 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:27:46.047827 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2b42f819-aea1-43e9-a9e1-fff96fdf50cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:46.048403 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2b42f819-aea1-43e9-a9e1-fff96fdf50cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:46.054927 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b42f819-aea1-43e9-a9e1-fff96fdf50cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:46.055403 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b42f819-aea1-43e9-a9e1-fff96fdf50cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:46.055862 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b42f819-aea1-43e9-a9e1-fff96fdf50cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:46.056538 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b42f819-aea1-43e9-a9e1-fff96fdf50cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:46.056986 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b42f819-aea1-43e9-a9e1-fff96fdf50cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:46.057401 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b42f819-aea1-43e9-a9e1-fff96fdf50cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:46.186236 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2b42f819-aea1-43e9-a9e1-fff96fdf50cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:46.195067 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2b42f819-aea1-43e9-a9e1-fff96fdf50cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:46.196534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2b42f819-aea1-43e9-a9e1-fff96fdf50cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:46.197691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2b42f819-aea1-43e9-a9e1-fff96fdf50cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1721 microversion: 2.20 time: 0.154212 Oct 06 12:27:46.198252 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 311/629] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:46 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:27:46.228465 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f94fd8f4-abb3-4e77-81fa-3d60d61ad135 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:46.229069 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f94fd8f4-abb3-4e77-81fa-3d60d61ad135 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:46.235915 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f94fd8f4-abb3-4e77-81fa-3d60d61ad135 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:46.236388 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f94fd8f4-abb3-4e77-81fa-3d60d61ad135 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:46.236815 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f94fd8f4-abb3-4e77-81fa-3d60d61ad135 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:46.237488 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f94fd8f4-abb3-4e77-81fa-3d60d61ad135 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:46.237940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f94fd8f4-abb3-4e77-81fa-3d60d61ad135 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:46.238360 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f94fd8f4-abb3-4e77-81fa-3d60d61ad135 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:46.366416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f94fd8f4-abb3-4e77-81fa-3d60d61ad135 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:46.373900 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f94fd8f4-abb3-4e77-81fa-3d60d61ad135 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1319 microversion: 2.1 time: 0.149167 Oct 06 12:27:46.374460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 319/630] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:46 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:27:47.223323 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d48859f7-7f58-49ee-af23-8bb1682e8a89 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:47.223960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d48859f7-7f58-49ee-af23-8bb1682e8a89 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:47.230214 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d48859f7-7f58-49ee-af23-8bb1682e8a89 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:47.230695 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d48859f7-7f58-49ee-af23-8bb1682e8a89 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:47.231126 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d48859f7-7f58-49ee-af23-8bb1682e8a89 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:47.231836 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d48859f7-7f58-49ee-af23-8bb1682e8a89 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:47.232285 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d48859f7-7f58-49ee-af23-8bb1682e8a89 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:47.232703 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d48859f7-7f58-49ee-af23-8bb1682e8a89 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:47.367028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d48859f7-7f58-49ee-af23-8bb1682e8a89 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:47.375761 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d48859f7-7f58-49ee-af23-8bb1682e8a89 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:47.377257 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d48859f7-7f58-49ee-af23-8bb1682e8a89 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:47.378417 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d48859f7-7f58-49ee-af23-8bb1682e8a89 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1721 microversion: 2.20 time: 0.158939 Oct 06 12:27:47.378975 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 312/631] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:47 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:27:47.403582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d9db725b-95db-4423-8d82-3b0dee34dd78 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:47.404213 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d9db725b-95db-4423-8d82-3b0dee34dd78 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:47.410697 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9db725b-95db-4423-8d82-3b0dee34dd78 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:47.411216 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9db725b-95db-4423-8d82-3b0dee34dd78 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:47.411688 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9db725b-95db-4423-8d82-3b0dee34dd78 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:47.412388 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9db725b-95db-4423-8d82-3b0dee34dd78 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:47.412847 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9db725b-95db-4423-8d82-3b0dee34dd78 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:47.413275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9db725b-95db-4423-8d82-3b0dee34dd78 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:47.540738 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d9db725b-95db-4423-8d82-3b0dee34dd78 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:47.548930 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d9db725b-95db-4423-8d82-3b0dee34dd78 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1319 microversion: 2.1 time: 0.149533 Oct 06 12:27:47.549514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 320/632] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:47 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:27:48.404092 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-16814713-ec98-404f-a952-d4add0704f6f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:48.404697 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-16814713-ec98-404f-a952-d4add0704f6f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:48.410965 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-16814713-ec98-404f-a952-d4add0704f6f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:48.411445 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-16814713-ec98-404f-a952-d4add0704f6f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:48.412087 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-16814713-ec98-404f-a952-d4add0704f6f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:48.412896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-16814713-ec98-404f-a952-d4add0704f6f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:48.413657 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-16814713-ec98-404f-a952-d4add0704f6f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:48.414407 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-16814713-ec98-404f-a952-d4add0704f6f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:48.552474 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-16814713-ec98-404f-a952-d4add0704f6f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:48.560417 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-16814713-ec98-404f-a952-d4add0704f6f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:48.561895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-16814713-ec98-404f-a952-d4add0704f6f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:48.563063 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-16814713-ec98-404f-a952-d4add0704f6f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1721 microversion: 2.20 time: 0.163197 Oct 06 12:27:48.563645 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 313/633] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:48 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:27:48.569947 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1ec63812-c2b1-4482-883a-3374f60fa9db tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:48.570554 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-1ec63812-c2b1-4482-883a-3374f60fa9db tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:48.576900 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1ec63812-c2b1-4482-883a-3374f60fa9db tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:48.577386 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1ec63812-c2b1-4482-883a-3374f60fa9db tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:48.578366 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1ec63812-c2b1-4482-883a-3374f60fa9db tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:48.579046 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1ec63812-c2b1-4482-883a-3374f60fa9db tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:48.579498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1ec63812-c2b1-4482-883a-3374f60fa9db tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:48.579938 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1ec63812-c2b1-4482-883a-3374f60fa9db tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:48.704077 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-1ec63812-c2b1-4482-883a-3374f60fa9db tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:48.711524 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-1ec63812-c2b1-4482-883a-3374f60fa9db tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1319 microversion: 2.1 time: 0.145352 Oct 06 12:27:48.712099 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 321/634] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:48 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:27:49.588867 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-71a8db3e-61b8-4c1b-bdd6-cb47e4b69c70 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:49.589465 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-71a8db3e-61b8-4c1b-bdd6-cb47e4b69c70 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:49.596302 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71a8db3e-61b8-4c1b-bdd6-cb47e4b69c70 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:49.596780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71a8db3e-61b8-4c1b-bdd6-cb47e4b69c70 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:49.597206 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71a8db3e-61b8-4c1b-bdd6-cb47e4b69c70 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:49.597878 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71a8db3e-61b8-4c1b-bdd6-cb47e4b69c70 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:49.598331 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71a8db3e-61b8-4c1b-bdd6-cb47e4b69c70 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:49.598739 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71a8db3e-61b8-4c1b-bdd6-cb47e4b69c70 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:49.725456 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-71a8db3e-61b8-4c1b-bdd6-cb47e4b69c70 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:49.733504 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e1a3aad6-9f04-4a63-8ee6-d1036dafa02e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:49.734647 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-71a8db3e-61b8-4c1b-bdd6-cb47e4b69c70 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:49.734777 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e1a3aad6-9f04-4a63-8ee6-d1036dafa02e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:49.735583 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-71a8db3e-61b8-4c1b-bdd6-cb47e4b69c70 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:49.736726 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-71a8db3e-61b8-4c1b-bdd6-cb47e4b69c70 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1721 microversion: 2.20 time: 0.151808 Oct 06 12:27:49.737288 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 314/635] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:49 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:27:49.741028 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e1a3aad6-9f04-4a63-8ee6-d1036dafa02e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:49.741510 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e1a3aad6-9f04-4a63-8ee6-d1036dafa02e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:49.741943 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e1a3aad6-9f04-4a63-8ee6-d1036dafa02e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:49.742634 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e1a3aad6-9f04-4a63-8ee6-d1036dafa02e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:49.743088 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e1a3aad6-9f04-4a63-8ee6-d1036dafa02e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:49.743527 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e1a3aad6-9f04-4a63-8ee6-d1036dafa02e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:49.867780 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e1a3aad6-9f04-4a63-8ee6-d1036dafa02e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:49.875747 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e1a3aad6-9f04-4a63-8ee6-d1036dafa02e tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1319 microversion: 2.1 time: 0.145948 Oct 06 12:27:49.876328 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 322/636] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:49 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:27:50.566991 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-4801bb8b-fbf2-4a18-bf17-ed0d17ae3d83 req-3bbb15e6-8dc2-4ff9-bc9e-feab0d0d8d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7438f9d0-89d0-430c-81bf-867fae34aa5c", "name": "network-vif-plugged", "status": "completed", "tag": "9419d7e0-c232-4196-aa32-65d6bd3e5076"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:27:50.572218 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:50.573105 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=6 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:50.579059 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-4801bb8b-fbf2-4a18-bf17-ed0d17ae3d83 req-3bbb15e6-8dc2-4ff9-bc9e-feab0d0d8d33 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:50.579579 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-4801bb8b-fbf2-4a18-bf17-ed0d17ae3d83 req-3bbb15e6-8dc2-4ff9-bc9e-feab0d0d8d33 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:50.580047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-4801bb8b-fbf2-4a18-bf17-ed0d17ae3d83 req-3bbb15e6-8dc2-4ff9-bc9e-feab0d0d8d33 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:50.591687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-4801bb8b-fbf2-4a18-bf17-ed0d17ae3d83 req-3bbb15e6-8dc2-4ff9-bc9e-feab0d0d8d33 service nova] Creating event network-vif-plugged:9419d7e0-c232-4196-aa32-65d6bd3e5076 for instance 7438f9d0-89d0-430c-81bf-867fae34aa5c on hv-cinder-85604 Oct 06 12:27:50.596514 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-4801bb8b-fbf2-4a18-bf17-ed0d17ae3d83 req-3bbb15e6-8dc2-4ff9-bc9e-feab0d0d8d33 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033774 Oct 06 12:27:50.597096 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 315/637] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:27:50.761451 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e542fd29-9f0d-49e1-ace6-b8fb24ba68d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:50.762057 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e542fd29-9f0d-49e1-ace6-b8fb24ba68d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:50.764654 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:50.770581 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e542fd29-9f0d-49e1-ace6-b8fb24ba68d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:50.771063 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e542fd29-9f0d-49e1-ace6-b8fb24ba68d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:50.771493 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e542fd29-9f0d-49e1-ace6-b8fb24ba68d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:50.772204 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e542fd29-9f0d-49e1-ace6-b8fb24ba68d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:50.772659 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e542fd29-9f0d-49e1-ace6-b8fb24ba68d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:50.773076 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e542fd29-9f0d-49e1-ace6-b8fb24ba68d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:50.902518 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-92199ed3-72a0-4ed2-86c0-7cd7d596ab9a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:50.903277 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-92199ed3-72a0-4ed2-86c0-7cd7d596ab9a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:50.905060 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e542fd29-9f0d-49e1-ace6-b8fb24ba68d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:50.910620 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-92199ed3-72a0-4ed2-86c0-7cd7d596ab9a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:50.911358 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-92199ed3-72a0-4ed2-86c0-7cd7d596ab9a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:50.911867 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-92199ed3-72a0-4ed2-86c0-7cd7d596ab9a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:50.912779 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-92199ed3-72a0-4ed2-86c0-7cd7d596ab9a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:50.913294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-92199ed3-72a0-4ed2-86c0-7cd7d596ab9a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:50.913753 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e542fd29-9f0d-49e1-ace6-b8fb24ba68d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:50.913886 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-92199ed3-72a0-4ed2-86c0-7cd7d596ab9a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:50.915202 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e542fd29-9f0d-49e1-ace6-b8fb24ba68d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:50.916482 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e542fd29-9f0d-49e1-ace6-b8fb24ba68d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1721 microversion: 2.20 time: 0.158966 Oct 06 12:27:50.917510 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 323/638] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:50 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:27:51.047903 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-92199ed3-72a0-4ed2-86c0-7cd7d596ab9a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:51.055747 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-92199ed3-72a0-4ed2-86c0-7cd7d596ab9a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1319 microversion: 2.1 time: 0.160728 Oct 06 12:27:51.056315 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 316/639] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:50 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:27:51.944665 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b072e8d4-8c6d-4b2d-99b2-c3ff20a129b0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:51.945223 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b072e8d4-8c6d-4b2d-99b2-c3ff20a129b0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:51.951552 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b072e8d4-8c6d-4b2d-99b2-c3ff20a129b0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:51.952033 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b072e8d4-8c6d-4b2d-99b2-c3ff20a129b0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:51.952459 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b072e8d4-8c6d-4b2d-99b2-c3ff20a129b0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:51.953136 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b072e8d4-8c6d-4b2d-99b2-c3ff20a129b0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:51.953589 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b072e8d4-8c6d-4b2d-99b2-c3ff20a129b0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:51.954008 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b072e8d4-8c6d-4b2d-99b2-c3ff20a129b0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:52.080359 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ffb8304c-4293-43f2-9e9f-787ae32106f8 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:52.081348 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ffb8304c-4293-43f2-9e9f-787ae32106f8 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:52.082433 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b072e8d4-8c6d-4b2d-99b2-c3ff20a129b0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:52.087181 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ffb8304c-4293-43f2-9e9f-787ae32106f8 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:52.087713 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ffb8304c-4293-43f2-9e9f-787ae32106f8 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:52.088150 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ffb8304c-4293-43f2-9e9f-787ae32106f8 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:52.088847 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ffb8304c-4293-43f2-9e9f-787ae32106f8 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:52.089337 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ffb8304c-4293-43f2-9e9f-787ae32106f8 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:52.089769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ffb8304c-4293-43f2-9e9f-787ae32106f8 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:52.091170 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b072e8d4-8c6d-4b2d-99b2-c3ff20a129b0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:52.092651 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b072e8d4-8c6d-4b2d-99b2-c3ff20a129b0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:52.094391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b072e8d4-8c6d-4b2d-99b2-c3ff20a129b0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1721 microversion: 2.20 time: 0.153684 Oct 06 12:27:52.094959 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 324/640] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:51 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:27:52.224503 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ffb8304c-4293-43f2-9e9f-787ae32106f8 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:52.231960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ffb8304c-4293-43f2-9e9f-787ae32106f8 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1319 microversion: 2.1 time: 0.156433 Oct 06 12:27:52.232517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 317/641] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:52 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:27:53.119978 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-16e161a5-52eb-4c85-bdef-24fc6e1e0ec0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:53.120589 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-16e161a5-52eb-4c85-bdef-24fc6e1e0ec0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:53.127344 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16e161a5-52eb-4c85-bdef-24fc6e1e0ec0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:53.127851 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16e161a5-52eb-4c85-bdef-24fc6e1e0ec0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:53.128283 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16e161a5-52eb-4c85-bdef-24fc6e1e0ec0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:53.128961 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16e161a5-52eb-4c85-bdef-24fc6e1e0ec0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:53.129412 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16e161a5-52eb-4c85-bdef-24fc6e1e0ec0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:53.129833 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16e161a5-52eb-4c85-bdef-24fc6e1e0ec0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:53.254664 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ab47deb5-ce1e-4c9a-9a0e-bf19c035a648 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:53.255350 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ab47deb5-ce1e-4c9a-9a0e-bf19c035a648 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:53.255839 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-16e161a5-52eb-4c85-bdef-24fc6e1e0ec0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:53.261997 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab47deb5-ce1e-4c9a-9a0e-bf19c035a648 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:53.262555 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab47deb5-ce1e-4c9a-9a0e-bf19c035a648 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:53.263069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab47deb5-ce1e-4c9a-9a0e-bf19c035a648 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:53.263852 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab47deb5-ce1e-4c9a-9a0e-bf19c035a648 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:53.264141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-16e161a5-52eb-4c85-bdef-24fc6e1e0ec0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:53.264489 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab47deb5-ce1e-4c9a-9a0e-bf19c035a648 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:53.264919 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab47deb5-ce1e-4c9a-9a0e-bf19c035a648 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:53.266463 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-16e161a5-52eb-4c85-bdef-24fc6e1e0ec0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:53.267658 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-16e161a5-52eb-4c85-bdef-24fc6e1e0ec0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1721 microversion: 2.20 time: 0.151555 Oct 06 12:27:53.268227 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 325/642] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:53 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:27:53.395014 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ab47deb5-ce1e-4c9a-9a0e-bf19c035a648 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:53.402807 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ab47deb5-ce1e-4c9a-9a0e-bf19c035a648 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1319 microversion: 2.1 time: 0.152036 Oct 06 12:27:53.403373 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 318/643] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:53 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:27:54.293192 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9ffc1097-e580-4c71-9510-fd3ec12b121d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:54.293800 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9ffc1097-e580-4c71-9510-fd3ec12b121d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:54.300286 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ffc1097-e580-4c71-9510-fd3ec12b121d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:54.300768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ffc1097-e580-4c71-9510-fd3ec12b121d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:54.301202 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ffc1097-e580-4c71-9510-fd3ec12b121d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:54.301888 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ffc1097-e580-4c71-9510-fd3ec12b121d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:54.302345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ffc1097-e580-4c71-9510-fd3ec12b121d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:54.302766 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ffc1097-e580-4c71-9510-fd3ec12b121d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:54.425015 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-6d7cc1f8-b6a9-4072-bb63-03c32592e07a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:54.425740 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-6d7cc1f8-b6a9-4072-bb63-03c32592e07a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:54.429989 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9ffc1097-e580-4c71-9510-fd3ec12b121d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:54.432245 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6d7cc1f8-b6a9-4072-bb63-03c32592e07a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:54.433016 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6d7cc1f8-b6a9-4072-bb63-03c32592e07a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:54.433800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6d7cc1f8-b6a9-4072-bb63-03c32592e07a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:54.434506 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6d7cc1f8-b6a9-4072-bb63-03c32592e07a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:54.434978 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6d7cc1f8-b6a9-4072-bb63-03c32592e07a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:54.435537 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6d7cc1f8-b6a9-4072-bb63-03c32592e07a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:54.439003 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9ffc1097-e580-4c71-9510-fd3ec12b121d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:54.440584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9ffc1097-e580-4c71-9510-fd3ec12b121d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:54.441849 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9ffc1097-e580-4c71-9510-fd3ec12b121d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1742 microversion: 2.20 time: 0.152556 Oct 06 12:27:54.446525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 326/644] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:54 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:27:54.563944 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-6d7cc1f8-b6a9-4072-bb63-03c32592e07a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:54.572974 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-6d7cc1f8-b6a9-4072-bb63-03c32592e07a tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1507 microversion: 2.1 time: 0.151939 Oct 06 12:27:54.573564 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 319/645] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:27:54 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:27:54.596773 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c837b81c-5909-4966-be1d-7c18ee5e0bb6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1831758e-1327-45a7-8d98-2551864c742f", "device": "/dev/sdb"}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:27:54.599641 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c837b81c-5909-4966-be1d-7c18ee5e0bb6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:54.605418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c837b81c-5909-4966-be1d-7c18ee5e0bb6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:54.605902 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c837b81c-5909-4966-be1d-7c18ee5e0bb6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:54.606336 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c837b81c-5909-4966-be1d-7c18ee5e0bb6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:54.607020 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c837b81c-5909-4966-be1d-7c18ee5e0bb6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:54.607477 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c837b81c-5909-4966-be1d-7c18ee5e0bb6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:54.607932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c837b81c-5909-4966-be1d-7c18ee5e0bb6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:54.943086 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c837b81c-5909-4966-be1d-7c18ee5e0bb6 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "POST /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350681 Oct 06 12:27:54.943847 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 327/646] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 12:27:54 2022] POST /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:27:55.467884 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c081a791-2a19-426d-9544-2ab2e96069a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:55.468513 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c081a791-2a19-426d-9544-2ab2e96069a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:55.474745 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c081a791-2a19-426d-9544-2ab2e96069a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:55.475220 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c081a791-2a19-426d-9544-2ab2e96069a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:55.475692 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c081a791-2a19-426d-9544-2ab2e96069a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:55.476372 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c081a791-2a19-426d-9544-2ab2e96069a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:55.476812 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c081a791-2a19-426d-9544-2ab2e96069a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:55.477225 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c081a791-2a19-426d-9544-2ab2e96069a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:55.605390 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c081a791-2a19-426d-9544-2ab2e96069a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:55.609451 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:55.614620 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c081a791-2a19-426d-9544-2ab2e96069a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:55.616097 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c081a791-2a19-426d-9544-2ab2e96069a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:55.617257 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c081a791-2a19-426d-9544-2ab2e96069a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1742 microversion: 2.20 time: 0.153435 Oct 06 12:27:55.617817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 320/647] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:55 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:27:56.583215 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-54571106-a4bf-41c4-825e-8d90a9799014 req-cc0e2bd5-7f42-43fd-acef-c0ae1551c4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b1825b8-e10c-4c5b-adf9-3456c97a68e2", "name": "network-vif-plugged", "status": "completed", "tag": "178adb30-0da6-4996-903a-4ee020de2a0a"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:27:56.593180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-54571106-a4bf-41c4-825e-8d90a9799014 req-cc0e2bd5-7f42-43fd-acef-c0ae1551c4a6 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:56.593656 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-54571106-a4bf-41c4-825e-8d90a9799014 req-cc0e2bd5-7f42-43fd-acef-c0ae1551c4a6 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:56.594080 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-54571106-a4bf-41c4-825e-8d90a9799014 req-cc0e2bd5-7f42-43fd-acef-c0ae1551c4a6 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:56.604971 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-54571106-a4bf-41c4-825e-8d90a9799014 req-cc0e2bd5-7f42-43fd-acef-c0ae1551c4a6 service nova] Creating event network-vif-plugged:178adb30-0da6-4996-903a-4ee020de2a0a for instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 on hv-cinder-85604 Oct 06 12:27:56.610179 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-54571106-a4bf-41c4-825e-8d90a9799014 req-cc0e2bd5-7f42-43fd-acef-c0ae1551c4a6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031715 Oct 06 12:27:56.610766 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 328/648] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:27:56.642189 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7a32bd15-8d20-4992-b58a-8546c8565058 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:56.642793 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7a32bd15-8d20-4992-b58a-8546c8565058 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:56.650335 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7a32bd15-8d20-4992-b58a-8546c8565058 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:56.650814 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7a32bd15-8d20-4992-b58a-8546c8565058 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:56.651242 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7a32bd15-8d20-4992-b58a-8546c8565058 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:56.652204 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7a32bd15-8d20-4992-b58a-8546c8565058 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:56.652647 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7a32bd15-8d20-4992-b58a-8546c8565058 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:56.653088 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7a32bd15-8d20-4992-b58a-8546c8565058 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:56.777101 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7a32bd15-8d20-4992-b58a-8546c8565058 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:56.784954 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7a32bd15-8d20-4992-b58a-8546c8565058 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:56.786381 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7a32bd15-8d20-4992-b58a-8546c8565058 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:56.787542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7a32bd15-8d20-4992-b58a-8546c8565058 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1742 microversion: 2.20 time: 0.149202 Oct 06 12:27:56.788083 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 321/649] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:56 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1742 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:27:57.813398 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9462fedc-bc67-41e2-a0f7-76f83157733b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:57.814098 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9462fedc-bc67-41e2-a0f7-76f83157733b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:57.820084 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9462fedc-bc67-41e2-a0f7-76f83157733b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:57.820559 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9462fedc-bc67-41e2-a0f7-76f83157733b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:57.820987 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9462fedc-bc67-41e2-a0f7-76f83157733b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:57.821664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9462fedc-bc67-41e2-a0f7-76f83157733b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:57.822112 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9462fedc-bc67-41e2-a0f7-76f83157733b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:57.822527 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9462fedc-bc67-41e2-a0f7-76f83157733b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:57.949766 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9462fedc-bc67-41e2-a0f7-76f83157733b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:57.953899 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:57.959426 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9462fedc-bc67-41e2-a0f7-76f83157733b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:57.960903 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9462fedc-bc67-41e2-a0f7-76f83157733b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:57.962071 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9462fedc-bc67-41e2-a0f7-76f83157733b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1742 microversion: 2.20 time: 0.153842 Oct 06 12:27:57.962628 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 329/650] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:57 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:27:58.986666 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-86ef7b5c-8d86-4080-b656-6a9d01b054ca tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:27:58.987263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-86ef7b5c-8d86-4080-b656-6a9d01b054ca tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:27:58.993632 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-86ef7b5c-8d86-4080-b656-6a9d01b054ca tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:58.994107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-86ef7b5c-8d86-4080-b656-6a9d01b054ca tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:58.994531 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-86ef7b5c-8d86-4080-b656-6a9d01b054ca tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:58.995201 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-86ef7b5c-8d86-4080-b656-6a9d01b054ca tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:27:58.995679 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-86ef7b5c-8d86-4080-b656-6a9d01b054ca tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:27:58.996098 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-86ef7b5c-8d86-4080-b656-6a9d01b054ca tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:27:59.120671 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-86ef7b5c-8d86-4080-b656-6a9d01b054ca tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:59.128579 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-86ef7b5c-8d86-4080-b656-6a9d01b054ca tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:59.130020 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-86ef7b5c-8d86-4080-b656-6a9d01b054ca tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:27:59.131138 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-86ef7b5c-8d86-4080-b656-6a9d01b054ca tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1742 microversion: 2.20 time: 0.148862 Oct 06 12:27:59.131717 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 322/651] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:27:58 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1742 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:00.157239 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9de784e7-b3ca-4302-9f67-058773e5e519 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:00.157840 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9de784e7-b3ca-4302-9f67-058773e5e519 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:00.164860 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9de784e7-b3ca-4302-9f67-058773e5e519 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:00.165338 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9de784e7-b3ca-4302-9f67-058773e5e519 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:00.165761 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9de784e7-b3ca-4302-9f67-058773e5e519 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:00.166441 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9de784e7-b3ca-4302-9f67-058773e5e519 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:00.166887 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9de784e7-b3ca-4302-9f67-058773e5e519 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:00.167305 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9de784e7-b3ca-4302-9f67-058773e5e519 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:00.294946 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9de784e7-b3ca-4302-9f67-058773e5e519 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:00.303049 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9de784e7-b3ca-4302-9f67-058773e5e519 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:00.304517 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9de784e7-b3ca-4302-9f67-058773e5e519 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:00.305666 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9de784e7-b3ca-4302-9f67-058773e5e519 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1742 microversion: 2.20 time: 0.153459 Oct 06 12:28:00.306216 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 330/652] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:00 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:01.330343 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8fa66783-c753-4904-a35f-1808f78f2f0e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:01.330977 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8fa66783-c753-4904-a35f-1808f78f2f0e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:01.337492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8fa66783-c753-4904-a35f-1808f78f2f0e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:01.337971 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8fa66783-c753-4904-a35f-1808f78f2f0e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:01.338406 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8fa66783-c753-4904-a35f-1808f78f2f0e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:01.339087 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8fa66783-c753-4904-a35f-1808f78f2f0e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:01.339572 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8fa66783-c753-4904-a35f-1808f78f2f0e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:01.340049 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8fa66783-c753-4904-a35f-1808f78f2f0e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:01.475320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8fa66783-c753-4904-a35f-1808f78f2f0e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:01.483253 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8fa66783-c753-4904-a35f-1808f78f2f0e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:01.484708 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8fa66783-c753-4904-a35f-1808f78f2f0e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:01.485833 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8fa66783-c753-4904-a35f-1808f78f2f0e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1742 microversion: 2.20 time: 0.159981 Oct 06 12:28:01.486384 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 323/653] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:01 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:02.511358 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ffa84918-a083-431f-bfcd-e8204f36021a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:02.511933 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ffa84918-a083-431f-bfcd-e8204f36021a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:02.518764 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ffa84918-a083-431f-bfcd-e8204f36021a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:02.519252 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ffa84918-a083-431f-bfcd-e8204f36021a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:02.519730 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ffa84918-a083-431f-bfcd-e8204f36021a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:02.520423 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ffa84918-a083-431f-bfcd-e8204f36021a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:02.520881 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ffa84918-a083-431f-bfcd-e8204f36021a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:02.521309 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ffa84918-a083-431f-bfcd-e8204f36021a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:02.659571 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ffa84918-a083-431f-bfcd-e8204f36021a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:02.667641 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ffa84918-a083-431f-bfcd-e8204f36021a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:02.669075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ffa84918-a083-431f-bfcd-e8204f36021a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:02.670645 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ffa84918-a083-431f-bfcd-e8204f36021a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1742 microversion: 2.20 time: 0.163242 Oct 06 12:28:02.671196 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 331/654] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:02 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:03.696805 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-014243b9-91dc-4fdb-8655-85dac521b86a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:03.698001 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-014243b9-91dc-4fdb-8655-85dac521b86a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:03.705457 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-014243b9-91dc-4fdb-8655-85dac521b86a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:03.706162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-014243b9-91dc-4fdb-8655-85dac521b86a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:03.706595 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-014243b9-91dc-4fdb-8655-85dac521b86a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:03.707297 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-014243b9-91dc-4fdb-8655-85dac521b86a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:03.707769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-014243b9-91dc-4fdb-8655-85dac521b86a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:03.708369 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-014243b9-91dc-4fdb-8655-85dac521b86a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:03.853763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-014243b9-91dc-4fdb-8655-85dac521b86a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:03.863051 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-014243b9-91dc-4fdb-8655-85dac521b86a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:03.864996 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-014243b9-91dc-4fdb-8655-85dac521b86a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:03.866457 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-014243b9-91dc-4fdb-8655-85dac521b86a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1737 microversion: 2.20 time: 0.173738 Oct 06 12:28:03.867389 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 324/655] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:03 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:04.898781 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ce9578c6-fd40-4c07-a33c-cb599b97ceec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:04.899592 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ce9578c6-fd40-4c07-a33c-cb599b97ceec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:04.908566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ce9578c6-fd40-4c07-a33c-cb599b97ceec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:04.909171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ce9578c6-fd40-4c07-a33c-cb599b97ceec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:04.909708 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ce9578c6-fd40-4c07-a33c-cb599b97ceec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:04.910504 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ce9578c6-fd40-4c07-a33c-cb599b97ceec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:04.911165 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ce9578c6-fd40-4c07-a33c-cb599b97ceec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:04.911852 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ce9578c6-fd40-4c07-a33c-cb599b97ceec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:05.053763 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ce9578c6-fd40-4c07-a33c-cb599b97ceec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:05.062488 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ce9578c6-fd40-4c07-a33c-cb599b97ceec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:05.063960 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ce9578c6-fd40-4c07-a33c-cb599b97ceec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:05.065140 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ce9578c6-fd40-4c07-a33c-cb599b97ceec tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1737 microversion: 2.20 time: 0.170843 Oct 06 12:28:05.080305 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 332/656] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:04 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:06.093185 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-da7135b2-39d2-4652-bdf9-e97679e77397 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:06.093984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-da7135b2-39d2-4652-bdf9-e97679e77397 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:06.101289 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da7135b2-39d2-4652-bdf9-e97679e77397 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:06.102092 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da7135b2-39d2-4652-bdf9-e97679e77397 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:06.102757 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da7135b2-39d2-4652-bdf9-e97679e77397 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:06.103558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da7135b2-39d2-4652-bdf9-e97679e77397 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:06.104089 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da7135b2-39d2-4652-bdf9-e97679e77397 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:06.104522 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da7135b2-39d2-4652-bdf9-e97679e77397 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:06.250531 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-da7135b2-39d2-4652-bdf9-e97679e77397 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:06.263793 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-da7135b2-39d2-4652-bdf9-e97679e77397 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:06.267989 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-da7135b2-39d2-4652-bdf9-e97679e77397 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:06.270260 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-da7135b2-39d2-4652-bdf9-e97679e77397 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1737 microversion: 2.20 time: 0.181318 Oct 06 12:28:06.272258 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 325/657] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:06 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:07.297454 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-94baddb2-02c1-4280-85c8-1d6f2d75d016 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:07.298674 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-94baddb2-02c1-4280-85c8-1d6f2d75d016 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:07.305473 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-94baddb2-02c1-4280-85c8-1d6f2d75d016 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:07.306168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-94baddb2-02c1-4280-85c8-1d6f2d75d016 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:07.306603 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-94baddb2-02c1-4280-85c8-1d6f2d75d016 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:07.307314 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-94baddb2-02c1-4280-85c8-1d6f2d75d016 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:07.307954 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-94baddb2-02c1-4280-85c8-1d6f2d75d016 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:07.308536 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-94baddb2-02c1-4280-85c8-1d6f2d75d016 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:07.448260 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-94baddb2-02c1-4280-85c8-1d6f2d75d016 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:07.456987 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-94baddb2-02c1-4280-85c8-1d6f2d75d016 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:07.458555 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-94baddb2-02c1-4280-85c8-1d6f2d75d016 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:07.460044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-94baddb2-02c1-4280-85c8-1d6f2d75d016 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1737 microversion: 2.20 time: 0.167216 Oct 06 12:28:07.460828 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 333/658] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:07 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:08.487647 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7fa43a86-634a-41d3-a4d9-d77e692ff895 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:08.488377 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7fa43a86-634a-41d3-a4d9-d77e692ff895 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:08.496286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7fa43a86-634a-41d3-a4d9-d77e692ff895 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:08.496709 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7fa43a86-634a-41d3-a4d9-d77e692ff895 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:08.497147 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7fa43a86-634a-41d3-a4d9-d77e692ff895 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:08.497875 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7fa43a86-634a-41d3-a4d9-d77e692ff895 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:08.498345 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7fa43a86-634a-41d3-a4d9-d77e692ff895 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:08.498800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7fa43a86-634a-41d3-a4d9-d77e692ff895 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:08.685025 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7fa43a86-634a-41d3-a4d9-d77e692ff895 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:08.694460 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7fa43a86-634a-41d3-a4d9-d77e692ff895 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:08.695997 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7fa43a86-634a-41d3-a4d9-d77e692ff895 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:08.697313 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7fa43a86-634a-41d3-a4d9-d77e692ff895 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1737 microversion: 2.20 time: 0.215019 Oct 06 12:28:08.711815 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 326/659] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:08 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:09.724340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3f90051d-86ed-4fb5-836e-69f9c2bbbcc9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:09.724957 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3f90051d-86ed-4fb5-836e-69f9c2bbbcc9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:09.727732 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=47 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:09.733825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3f90051d-86ed-4fb5-836e-69f9c2bbbcc9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:09.734607 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3f90051d-86ed-4fb5-836e-69f9c2bbbcc9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:09.735110 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3f90051d-86ed-4fb5-836e-69f9c2bbbcc9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:09.736059 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3f90051d-86ed-4fb5-836e-69f9c2bbbcc9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:09.736819 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3f90051d-86ed-4fb5-836e-69f9c2bbbcc9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:09.737468 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3f90051d-86ed-4fb5-836e-69f9c2bbbcc9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:09.902476 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3f90051d-86ed-4fb5-836e-69f9c2bbbcc9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:09.911595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3f90051d-86ed-4fb5-836e-69f9c2bbbcc9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:09.914811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3f90051d-86ed-4fb5-836e-69f9c2bbbcc9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:09.916366 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3f90051d-86ed-4fb5-836e-69f9c2bbbcc9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1737 microversion: 2.20 time: 0.196857 Oct 06 12:28:09.920594 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 334/660] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:09 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:10.948977 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-bcca14c2-a16d-44de-98c6-fb7577cef0f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:10.950318 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-bcca14c2-a16d-44de-98c6-fb7577cef0f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:10.956936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:10.958844 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bcca14c2-a16d-44de-98c6-fb7577cef0f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:10.959615 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bcca14c2-a16d-44de-98c6-fb7577cef0f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:10.960284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bcca14c2-a16d-44de-98c6-fb7577cef0f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:10.961212 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bcca14c2-a16d-44de-98c6-fb7577cef0f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:10.961843 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bcca14c2-a16d-44de-98c6-fb7577cef0f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:10.962449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bcca14c2-a16d-44de-98c6-fb7577cef0f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:11.104926 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-bcca14c2-a16d-44de-98c6-fb7577cef0f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:11.113738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-bcca14c2-a16d-44de-98c6-fb7577cef0f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:11.114705 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-bcca14c2-a16d-44de-98c6-fb7577cef0f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:11.119670 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-bcca14c2-a16d-44de-98c6-fb7577cef0f2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1737 microversion: 2.20 time: 0.173396 Oct 06 12:28:11.121088 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 327/661] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:10 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:12.145555 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3f206b28-1419-4189-bada-fab84ca4cee6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:12.146307 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3f206b28-1419-4189-bada-fab84ca4cee6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:12.153237 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3f206b28-1419-4189-bada-fab84ca4cee6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:12.153734 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3f206b28-1419-4189-bada-fab84ca4cee6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:12.154173 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3f206b28-1419-4189-bada-fab84ca4cee6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:12.155370 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3f206b28-1419-4189-bada-fab84ca4cee6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:12.156029 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3f206b28-1419-4189-bada-fab84ca4cee6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:12.156592 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3f206b28-1419-4189-bada-fab84ca4cee6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:12.287356 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3f206b28-1419-4189-bada-fab84ca4cee6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:12.295832 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3f206b28-1419-4189-bada-fab84ca4cee6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:12.297275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3f206b28-1419-4189-bada-fab84ca4cee6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:12.298430 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3f206b28-1419-4189-bada-fab84ca4cee6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1737 microversion: 2.20 time: 0.156746 Oct 06 12:28:12.298991 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 335/662] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:12 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:13.323236 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-11dbf5d6-9376-449b-89ce-b88a63149ca8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:13.323810 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-11dbf5d6-9376-449b-89ce-b88a63149ca8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:13.330337 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11dbf5d6-9376-449b-89ce-b88a63149ca8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:13.330816 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11dbf5d6-9376-449b-89ce-b88a63149ca8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:13.331245 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11dbf5d6-9376-449b-89ce-b88a63149ca8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:13.331959 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11dbf5d6-9376-449b-89ce-b88a63149ca8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:13.332410 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11dbf5d6-9376-449b-89ce-b88a63149ca8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:13.332831 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11dbf5d6-9376-449b-89ce-b88a63149ca8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:13.456983 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-11dbf5d6-9376-449b-89ce-b88a63149ca8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:13.464868 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-11dbf5d6-9376-449b-89ce-b88a63149ca8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:13.466309 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-11dbf5d6-9376-449b-89ce-b88a63149ca8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:13.468019 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-11dbf5d6-9376-449b-89ce-b88a63149ca8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1737 microversion: 2.20 time: 0.148659 Oct 06 12:28:13.468578 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 328/663] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:13 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:14.029216 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e0c94063-6464-4cfc-89e6-7d94cc18168b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0285b46f-880e-40e1-b475-20d785de50ba"}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:28:14.032197 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e0c94063-6464-4cfc-89e6-7d94cc18168b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:14.038001 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e0c94063-6464-4cfc-89e6-7d94cc18168b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:14.038476 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e0c94063-6464-4cfc-89e6-7d94cc18168b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:14.038907 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e0c94063-6464-4cfc-89e6-7d94cc18168b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:14.039614 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e0c94063-6464-4cfc-89e6-7d94cc18168b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:14.040068 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e0c94063-6464-4cfc-89e6-7d94cc18168b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:14.040487 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e0c94063-6464-4cfc-89e6-7d94cc18168b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:14.493494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c2299ee2-dd25-4efa-82f6-80e21521d35d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:14.494019 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c2299ee2-dd25-4efa-82f6-80e21521d35d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:14.500945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2299ee2-dd25-4efa-82f6-80e21521d35d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:14.501426 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2299ee2-dd25-4efa-82f6-80e21521d35d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:14.501859 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2299ee2-dd25-4efa-82f6-80e21521d35d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:14.502539 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2299ee2-dd25-4efa-82f6-80e21521d35d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:14.502989 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2299ee2-dd25-4efa-82f6-80e21521d35d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:14.503414 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2299ee2-dd25-4efa-82f6-80e21521d35d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:14.628323 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c2299ee2-dd25-4efa-82f6-80e21521d35d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:14.636797 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c2299ee2-dd25-4efa-82f6-80e21521d35d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:14.638240 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c2299ee2-dd25-4efa-82f6-80e21521d35d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:14.639399 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c2299ee2-dd25-4efa-82f6-80e21521d35d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1737 microversion: 2.20 time: 0.149911 Oct 06 12:28:14.639982 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 329/664] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:14 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:14.737419 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e0c94063-6464-4cfc-89e6-7d94cc18168b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "POST /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.814675 Oct 06 12:28:14.738051 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 336/665] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 12:28:13 2022] POST /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-volume_attachments => generated 194 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:28:15.665286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2f36407d-84ee-4cc4-a8dd-fae731ade833 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:15.665900 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2f36407d-84ee-4cc4-a8dd-fae731ade833 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:15.672240 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f36407d-84ee-4cc4-a8dd-fae731ade833 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:15.672718 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f36407d-84ee-4cc4-a8dd-fae731ade833 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:15.673208 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f36407d-84ee-4cc4-a8dd-fae731ade833 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:15.673904 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f36407d-84ee-4cc4-a8dd-fae731ade833 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:15.674360 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f36407d-84ee-4cc4-a8dd-fae731ade833 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:15.674786 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f36407d-84ee-4cc4-a8dd-fae731ade833 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:15.804990 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2f36407d-84ee-4cc4-a8dd-fae731ade833 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:15.814883 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2f36407d-84ee-4cc4-a8dd-fae731ade833 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:15.816932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2f36407d-84ee-4cc4-a8dd-fae731ade833 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:15.818113 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2f36407d-84ee-4cc4-a8dd-fae731ade833 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1737 microversion: 2.20 time: 0.156708 Oct 06 12:28:15.818675 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 330/666] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:15 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:16.844518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-93a2d7c3-a063-453e-b090-a8c2be8fc901 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:16.845240 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-93a2d7c3-a063-453e-b090-a8c2be8fc901 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:16.852225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-93a2d7c3-a063-453e-b090-a8c2be8fc901 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:16.852708 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-93a2d7c3-a063-453e-b090-a8c2be8fc901 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:16.853143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-93a2d7c3-a063-453e-b090-a8c2be8fc901 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:16.853831 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-93a2d7c3-a063-453e-b090-a8c2be8fc901 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:16.854281 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-93a2d7c3-a063-453e-b090-a8c2be8fc901 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:16.854703 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-93a2d7c3-a063-453e-b090-a8c2be8fc901 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:16.994237 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-93a2d7c3-a063-453e-b090-a8c2be8fc901 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:17.004126 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-93a2d7c3-a063-453e-b090-a8c2be8fc901 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:17.005829 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-93a2d7c3-a063-453e-b090-a8c2be8fc901 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:17.006995 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-93a2d7c3-a063-453e-b090-a8c2be8fc901 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1719 microversion: 2.20 time: 0.167345 Oct 06 12:28:17.008116 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 337/667] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:16 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:18.034448 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b83f1749-7f9a-47f9-bcd3-7a3584ac91ba tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:18.035175 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b83f1749-7f9a-47f9-bcd3-7a3584ac91ba tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:18.042525 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b83f1749-7f9a-47f9-bcd3-7a3584ac91ba tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:18.043104 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b83f1749-7f9a-47f9-bcd3-7a3584ac91ba tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:18.043626 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b83f1749-7f9a-47f9-bcd3-7a3584ac91ba tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:18.044436 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b83f1749-7f9a-47f9-bcd3-7a3584ac91ba tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:18.045518 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b83f1749-7f9a-47f9-bcd3-7a3584ac91ba tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:18.045997 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b83f1749-7f9a-47f9-bcd3-7a3584ac91ba tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:18.180903 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b83f1749-7f9a-47f9-bcd3-7a3584ac91ba tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:18.190314 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b83f1749-7f9a-47f9-bcd3-7a3584ac91ba tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:18.192023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b83f1749-7f9a-47f9-bcd3-7a3584ac91ba tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:18.193443 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b83f1749-7f9a-47f9-bcd3-7a3584ac91ba tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1719 microversion: 2.20 time: 0.163512 Oct 06 12:28:18.194147 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 331/668] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:18 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:19.222196 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f94c3f9c-a6fa-4406-b3e2-766e28c6c127 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:19.222811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f94c3f9c-a6fa-4406-b3e2-766e28c6c127 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:19.229103 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f94c3f9c-a6fa-4406-b3e2-766e28c6c127 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:19.229728 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f94c3f9c-a6fa-4406-b3e2-766e28c6c127 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:19.230178 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f94c3f9c-a6fa-4406-b3e2-766e28c6c127 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:19.230952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f94c3f9c-a6fa-4406-b3e2-766e28c6c127 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:19.231435 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f94c3f9c-a6fa-4406-b3e2-766e28c6c127 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:19.231890 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f94c3f9c-a6fa-4406-b3e2-766e28c6c127 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:19.359818 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f94c3f9c-a6fa-4406-b3e2-766e28c6c127 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:19.367870 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f94c3f9c-a6fa-4406-b3e2-766e28c6c127 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:19.369318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f94c3f9c-a6fa-4406-b3e2-766e28c6c127 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:19.370502 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f94c3f9c-a6fa-4406-b3e2-766e28c6c127 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1719 microversion: 2.20 time: 0.152246 Oct 06 12:28:19.371067 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 338/669] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:19 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:19.597336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-54273388-7e77-43ec-924f-bb83f0eb8e75 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:19.597851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-54273388-7e77-43ec-924f-bb83f0eb8e75 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:19.604459 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-54273388-7e77-43ec-924f-bb83f0eb8e75 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:19.605006 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-54273388-7e77-43ec-924f-bb83f0eb8e75 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:19.605442 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-54273388-7e77-43ec-924f-bb83f0eb8e75 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:19.606128 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-54273388-7e77-43ec-924f-bb83f0eb8e75 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:19.606578 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-54273388-7e77-43ec-924f-bb83f0eb8e75 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:19.607039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-54273388-7e77-43ec-924f-bb83f0eb8e75 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:19.734021 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-54273388-7e77-43ec-924f-bb83f0eb8e75 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lazy-loading 'services' on Instance uuid 7438f9d0-89d0-430c-81bf-867fae34aa5c {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:28:19.845338 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-54273388-7e77-43ec-924f-bb83f0eb8e75 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c/os-volume_attachments/1831758e-1327-45a7-8d98-2551864c742f" status: 202 len: 0 microversion: 2.1 time: 0.251762 Oct 06 12:28:19.845953 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 332/670] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 12:28:19 2022] DELETE /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c/os-volume_attachments/1831758e-1327-45a7-8d98-2551864c742f => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:28:20.396745 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a26f7676-e53a-4691-aab5-f94e8dce6269 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:20.397360 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a26f7676-e53a-4691-aab5-f94e8dce6269 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:20.403973 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a26f7676-e53a-4691-aab5-f94e8dce6269 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:20.404457 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a26f7676-e53a-4691-aab5-f94e8dce6269 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:20.404888 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a26f7676-e53a-4691-aab5-f94e8dce6269 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:20.405572 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a26f7676-e53a-4691-aab5-f94e8dce6269 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:20.406027 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a26f7676-e53a-4691-aab5-f94e8dce6269 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:20.406454 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a26f7676-e53a-4691-aab5-f94e8dce6269 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:20.537073 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a26f7676-e53a-4691-aab5-f94e8dce6269 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:20.545792 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a26f7676-e53a-4691-aab5-f94e8dce6269 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:20.547279 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a26f7676-e53a-4691-aab5-f94e8dce6269 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:20.548500 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a26f7676-e53a-4691-aab5-f94e8dce6269 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1662 microversion: 2.20 time: 0.155693 Oct 06 12:28:20.549277 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 339/671] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:20 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:20.574407 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-71d6bd10-41d0-4a29-858f-aab60d74482d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53c981e4-3e27-4144-acfc-63ccb3318b4c"}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:28:20.577095 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-71d6bd10-41d0-4a29-858f-aab60d74482d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:20.583683 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71d6bd10-41d0-4a29-858f-aab60d74482d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:20.584166 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71d6bd10-41d0-4a29-858f-aab60d74482d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:20.584597 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71d6bd10-41d0-4a29-858f-aab60d74482d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:20.585282 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71d6bd10-41d0-4a29-858f-aab60d74482d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:20.585726 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71d6bd10-41d0-4a29-858f-aab60d74482d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:20.586141 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71d6bd10-41d0-4a29-858f-aab60d74482d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:20.675541 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-7ad9f138-5244-49a8-a25b-f5e010837e3c req-97f79f04-7caa-44db-a8ac-9b9982dfefce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b1825b8-e10c-4c5b-adf9-3456c97a68e2", "name": "network-vif-unplugged", "status": "completed", "tag": "178adb30-0da6-4996-903a-4ee020de2a0a"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:28:20.687407 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-7ad9f138-5244-49a8-a25b-f5e010837e3c req-97f79f04-7caa-44db-a8ac-9b9982dfefce service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:20.687407 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-7ad9f138-5244-49a8-a25b-f5e010837e3c req-97f79f04-7caa-44db-a8ac-9b9982dfefce service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:20.687778 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-7ad9f138-5244-49a8-a25b-f5e010837e3c req-97f79f04-7caa-44db-a8ac-9b9982dfefce service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:20.699051 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.compute.server_external_events [req-7ad9f138-5244-49a8-a25b-f5e010837e3c req-97f79f04-7caa-44db-a8ac-9b9982dfefce service nova] Unable to find a host for instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2. Dropping event network-vif-unplugged {{(pid=120508) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 06 12:28:20.700425 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-7ad9f138-5244-49a8-a25b-f5e010837e3c req-97f79f04-7caa-44db-a8ac-9b9982dfefce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.090957 Oct 06 12:28:20.700609 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 340/672] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 06 12:28:20.872343 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-71d6bd10-41d0-4a29-858f-aab60d74482d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "POST /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302445 Oct 06 12:28:20.873168 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 333/673] 10.222.0.33 () {62 vars in 1364 bytes} [Thu Oct 6 12:28:20 2022] POST /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:28:21.000572 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d6e590f8-2ceb-481b-814b-123eee89ea5a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:28:21.001172 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d6e590f8-2ceb-481b-814b-123eee89ea5a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:21.006933 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6e590f8-2ceb-481b-814b-123eee89ea5a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:21.007423 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6e590f8-2ceb-481b-814b-123eee89ea5a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:21.007895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6e590f8-2ceb-481b-814b-123eee89ea5a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:21.008585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6e590f8-2ceb-481b-814b-123eee89ea5a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:21.009043 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6e590f8-2ceb-481b-814b-123eee89ea5a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:21.009471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6e590f8-2ceb-481b-814b-123eee89ea5a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:21.095645 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d6e590f8-2ceb-481b-814b-123eee89ea5a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120508) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 12:28:21.164921 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d6e590f8-2ceb-481b-814b-123eee89ea5a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "POST /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/action" status: 202 len: 0 microversion: 2.20 time: 0.168070 Oct 06 12:28:21.165513 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 341/674] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Oct 6 12:28:20 2022] POST /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:28:21.173716 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-16441d76-f81e-4277-ad4b-41929e9235fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:21.174317 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-16441d76-f81e-4277-ad4b-41929e9235fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:21.180617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-16441d76-f81e-4277-ad4b-41929e9235fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:21.181106 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-16441d76-f81e-4277-ad4b-41929e9235fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:21.181538 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-16441d76-f81e-4277-ad4b-41929e9235fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:21.182223 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-16441d76-f81e-4277-ad4b-41929e9235fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:21.182677 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-16441d76-f81e-4277-ad4b-41929e9235fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:21.183100 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-16441d76-f81e-4277-ad4b-41929e9235fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:21.187669 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:21.323486 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-16441d76-f81e-4277-ad4b-41929e9235fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:21.333185 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-16441d76-f81e-4277-ad4b-41929e9235fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:21.334621 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-16441d76-f81e-4277-ad4b-41929e9235fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:21.335836 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-16441d76-f81e-4277-ad4b-41929e9235fe tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1748 microversion: 2.20 time: 0.166126 Oct 06 12:28:21.336408 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 334/675] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:21 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:22.361665 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5cde7231-5f50-4728-8c75-6ab8854a94b5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:22.362265 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5cde7231-5f50-4728-8c75-6ab8854a94b5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:22.368165 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5cde7231-5f50-4728-8c75-6ab8854a94b5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:22.368646 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5cde7231-5f50-4728-8c75-6ab8854a94b5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:22.369075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5cde7231-5f50-4728-8c75-6ab8854a94b5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:22.369753 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5cde7231-5f50-4728-8c75-6ab8854a94b5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:22.370202 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5cde7231-5f50-4728-8c75-6ab8854a94b5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:22.370619 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5cde7231-5f50-4728-8c75-6ab8854a94b5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:22.498127 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5cde7231-5f50-4728-8c75-6ab8854a94b5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:22.506465 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5cde7231-5f50-4728-8c75-6ab8854a94b5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:22.507961 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5cde7231-5f50-4728-8c75-6ab8854a94b5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:22.509133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5cde7231-5f50-4728-8c75-6ab8854a94b5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1750 microversion: 2.20 time: 0.152151 Oct 06 12:28:22.509681 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 342/676] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:22 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:23.333765 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-40190f4d-d29b-423e-bd8a-256cf76bfa91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:28:23.336131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-40190f4d-d29b-423e-bd8a-256cf76bfa91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:23.342077 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-40190f4d-d29b-423e-bd8a-256cf76bfa91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:23.342561 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-40190f4d-d29b-423e-bd8a-256cf76bfa91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:23.342998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-40190f4d-d29b-423e-bd8a-256cf76bfa91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:23.343724 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-40190f4d-d29b-423e-bd8a-256cf76bfa91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:23.344184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-40190f4d-d29b-423e-bd8a-256cf76bfa91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:23.344613 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-40190f4d-d29b-423e-bd8a-256cf76bfa91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:23.366543 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-40190f4d-d29b-423e-bd8a-256cf76bfa91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lazy-loading 'flavor' on Instance uuid 1620fb3a-f872-41f2-83d2-909fbe71f438 {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:28:23.489645 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-40190f4d-d29b-423e-bd8a-256cf76bfa91 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "POST /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/action" status: 200 len: 32 microversion: 2.1 time: 0.159940 Oct 06 12:28:23.490363 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 335/677] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 12:28:23 2022] POST /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:28:23.500435 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6ee58dbf-a3a6-4710-b246-9628f6b80b5d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:23.501277 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-6ee58dbf-a3a6-4710-b246-9628f6b80b5d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:23.507872 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6ee58dbf-a3a6-4710-b246-9628f6b80b5d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:23.508503 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6ee58dbf-a3a6-4710-b246-9628f6b80b5d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:23.508966 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6ee58dbf-a3a6-4710-b246-9628f6b80b5d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:23.509641 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6ee58dbf-a3a6-4710-b246-9628f6b80b5d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:23.510384 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6ee58dbf-a3a6-4710-b246-9628f6b80b5d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:23.510838 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6ee58dbf-a3a6-4710-b246-9628f6b80b5d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:23.535687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8440ac36-7317-4c8f-b70f-85f4c5654562 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:23.536459 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8440ac36-7317-4c8f-b70f-85f4c5654562 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:23.542665 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8440ac36-7317-4c8f-b70f-85f4c5654562 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:23.543215 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8440ac36-7317-4c8f-b70f-85f4c5654562 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:23.543746 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8440ac36-7317-4c8f-b70f-85f4c5654562 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:23.545130 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8440ac36-7317-4c8f-b70f-85f4c5654562 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:23.545580 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8440ac36-7317-4c8f-b70f-85f4c5654562 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:23.546000 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8440ac36-7317-4c8f-b70f-85f4c5654562 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:23.714227 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6ee58dbf-a3a6-4710-b246-9628f6b80b5d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:23.726342 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-6ee58dbf-a3a6-4710-b246-9628f6b80b5d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.230311 Oct 06 12:28:23.727193 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 343/678] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:23 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:23.741640 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8440ac36-7317-4c8f-b70f-85f4c5654562 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:23.751601 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8440ac36-7317-4c8f-b70f-85f4c5654562 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:23.753185 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8440ac36-7317-4c8f-b70f-85f4c5654562 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:23.754583 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8440ac36-7317-4c8f-b70f-85f4c5654562 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1750 microversion: 2.20 time: 0.223231 Oct 06 12:28:23.755684 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 336/679] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:23 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1750 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:24.147474 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-67d1eb50-b9ca-43f8-aff7-b1bf818a9bdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:24.148156 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-67d1eb50-b9ca-43f8-aff7-b1bf818a9bdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:24.155156 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67d1eb50-b9ca-43f8-aff7-b1bf818a9bdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:24.155762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67d1eb50-b9ca-43f8-aff7-b1bf818a9bdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:24.156265 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67d1eb50-b9ca-43f8-aff7-b1bf818a9bdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:24.157060 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67d1eb50-b9ca-43f8-aff7-b1bf818a9bdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:24.157588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67d1eb50-b9ca-43f8-aff7-b1bf818a9bdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:24.158084 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67d1eb50-b9ca-43f8-aff7-b1bf818a9bdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:24.184655 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-67d1eb50-b9ca-43f8-aff7-b1bf818a9bdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Going to try to terminate instance {{(pid=120508) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:28:24.187890 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:24.272880 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-67d1eb50-b9ca-43f8-aff7-b1bf818a9bdb tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 204 len: 0 microversion: 2.1 time: 0.129031 Oct 06 12:28:24.273640 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 344/680] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:28:24 2022] DELETE /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 12:28:24.284117 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-6c95bc56-f3ff-404d-a99e-7fd1730f7605 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:24.284959 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-6c95bc56-f3ff-404d-a99e-7fd1730f7605 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:24.292879 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c95bc56-f3ff-404d-a99e-7fd1730f7605 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:24.293469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c95bc56-f3ff-404d-a99e-7fd1730f7605 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:24.293959 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c95bc56-f3ff-404d-a99e-7fd1730f7605 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:24.294721 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c95bc56-f3ff-404d-a99e-7fd1730f7605 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:24.295235 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c95bc56-f3ff-404d-a99e-7fd1730f7605 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:24.295779 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c95bc56-f3ff-404d-a99e-7fd1730f7605 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:24.425988 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-6c95bc56-f3ff-404d-a99e-7fd1730f7605 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:24.433593 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-6c95bc56-f3ff-404d-a99e-7fd1730f7605 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1513 microversion: 2.1 time: 0.155421 Oct 06 12:28:24.434152 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 337/681] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:24 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:28:24.751064 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c5efed3c-b6e2-4416-890a-577e3685f535 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:24.751809 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c5efed3c-b6e2-4416-890a-577e3685f535 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:24.758069 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c5efed3c-b6e2-4416-890a-577e3685f535 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:24.758553 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c5efed3c-b6e2-4416-890a-577e3685f535 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:24.758986 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c5efed3c-b6e2-4416-890a-577e3685f535 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:24.759702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c5efed3c-b6e2-4416-890a-577e3685f535 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:24.760157 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c5efed3c-b6e2-4416-890a-577e3685f535 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:24.760581 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c5efed3c-b6e2-4416-890a-577e3685f535 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:24.783158 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-252cd29c-d606-48bc-ab39-f39c96c5a651 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:24.783887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-252cd29c-d606-48bc-ab39-f39c96c5a651 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:24.790694 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-252cd29c-d606-48bc-ab39-f39c96c5a651 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:24.791177 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-252cd29c-d606-48bc-ab39-f39c96c5a651 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:24.791635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-252cd29c-d606-48bc-ab39-f39c96c5a651 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:24.792322 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-252cd29c-d606-48bc-ab39-f39c96c5a651 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:24.792772 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-252cd29c-d606-48bc-ab39-f39c96c5a651 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:24.793185 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-252cd29c-d606-48bc-ab39-f39c96c5a651 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:24.939616 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c5efed3c-b6e2-4416-890a-577e3685f535 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:24.951905 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c5efed3c-b6e2-4416-890a-577e3685f535 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.205475 Oct 06 12:28:24.952485 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 345/682] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:24 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:24.965411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-252cd29c-d606-48bc-ab39-f39c96c5a651 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:24.974614 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-252cd29c-d606-48bc-ab39-f39c96c5a651 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:24.976105 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-252cd29c-d606-48bc-ab39-f39c96c5a651 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:24.977254 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-252cd29c-d606-48bc-ab39-f39c96c5a651 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1750 microversion: 2.20 time: 0.198825 Oct 06 12:28:24.977808 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 338/683] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:24 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1750 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:25.457385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5d4fa107-d8b7-468c-a310-4f8adc04543d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:25.457998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5d4fa107-d8b7-468c-a310-4f8adc04543d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:25.463871 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5d4fa107-d8b7-468c-a310-4f8adc04543d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:25.464357 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5d4fa107-d8b7-468c-a310-4f8adc04543d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:25.464792 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5d4fa107-d8b7-468c-a310-4f8adc04543d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:25.465481 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5d4fa107-d8b7-468c-a310-4f8adc04543d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:25.465982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5d4fa107-d8b7-468c-a310-4f8adc04543d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:25.466406 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5d4fa107-d8b7-468c-a310-4f8adc04543d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:25.597201 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5d4fa107-d8b7-468c-a310-4f8adc04543d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:25.605011 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5d4fa107-d8b7-468c-a310-4f8adc04543d tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1513 microversion: 2.1 time: 0.151536 Oct 06 12:28:25.605578 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 346/684] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:25 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:25.976592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4913d316-4387-409d-8215-630be3c4bea4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:25.977197 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4913d316-4387-409d-8215-630be3c4bea4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:25.984019 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4913d316-4387-409d-8215-630be3c4bea4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:25.984501 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4913d316-4387-409d-8215-630be3c4bea4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:25.984935 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4913d316-4387-409d-8215-630be3c4bea4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:25.985619 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4913d316-4387-409d-8215-630be3c4bea4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:25.986070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4913d316-4387-409d-8215-630be3c4bea4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:25.986492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4913d316-4387-409d-8215-630be3c4bea4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:26.003040 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a5ea48ab-4b21-47e7-a636-91dd29a757b4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:26.003771 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a5ea48ab-4b21-47e7-a636-91dd29a757b4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:26.010067 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5ea48ab-4b21-47e7-a636-91dd29a757b4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:26.010554 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5ea48ab-4b21-47e7-a636-91dd29a757b4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:26.010986 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5ea48ab-4b21-47e7-a636-91dd29a757b4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:26.011711 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5ea48ab-4b21-47e7-a636-91dd29a757b4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:26.012182 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5ea48ab-4b21-47e7-a636-91dd29a757b4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:26.012597 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a5ea48ab-4b21-47e7-a636-91dd29a757b4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:26.177346 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4913d316-4387-409d-8215-630be3c4bea4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:26.183891 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a5ea48ab-4b21-47e7-a636-91dd29a757b4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:26.186360 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4913d316-4387-409d-8215-630be3c4bea4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.213230 Oct 06 12:28:26.187170 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 339/685] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:25 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:26.192561 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a5ea48ab-4b21-47e7-a636-91dd29a757b4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:26.194000 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a5ea48ab-4b21-47e7-a636-91dd29a757b4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:26.195146 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a5ea48ab-4b21-47e7-a636-91dd29a757b4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1750 microversion: 2.20 time: 0.195958 Oct 06 12:28:26.195715 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 347/686] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:25 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1750 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:26.627451 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-178e32d1-e127-42a7-9c7c-816b24451f73 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:26.628093 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-178e32d1-e127-42a7-9c7c-816b24451f73 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:26.634183 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-178e32d1-e127-42a7-9c7c-816b24451f73 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:26.634662 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-178e32d1-e127-42a7-9c7c-816b24451f73 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:26.635099 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-178e32d1-e127-42a7-9c7c-816b24451f73 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:26.635868 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-178e32d1-e127-42a7-9c7c-816b24451f73 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:26.636317 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-178e32d1-e127-42a7-9c7c-816b24451f73 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:26.636738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-178e32d1-e127-42a7-9c7c-816b24451f73 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:26.774912 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-178e32d1-e127-42a7-9c7c-816b24451f73 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:26.783539 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-178e32d1-e127-42a7-9c7c-816b24451f73 tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1513 microversion: 2.1 time: 0.159863 Oct 06 12:28:26.784433 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 340/687] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:26 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:27.069151 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-163a1425-9830-4bd8-b352-90872d73cf55 req-5ca6b4ae-47e8-4eef-be2f-166d6df9a2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7438f9d0-89d0-430c-81bf-867fae34aa5c", "name": "network-vif-deleted", "tag": "9419d7e0-c232-4196-aa32-65d6bd3e5076"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:28:27.079014 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-163a1425-9830-4bd8-b352-90872d73cf55 req-5ca6b4ae-47e8-4eef-be2f-166d6df9a2e7 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:27.079493 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-163a1425-9830-4bd8-b352-90872d73cf55 req-5ca6b4ae-47e8-4eef-be2f-166d6df9a2e7 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:27.079955 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-163a1425-9830-4bd8-b352-90872d73cf55 req-5ca6b4ae-47e8-4eef-be2f-166d6df9a2e7 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:27.093169 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-163a1425-9830-4bd8-b352-90872d73cf55 req-5ca6b4ae-47e8-4eef-be2f-166d6df9a2e7 service nova] Creating event network-vif-deleted:9419d7e0-c232-4196-aa32-65d6bd3e5076 for instance 7438f9d0-89d0-430c-81bf-867fae34aa5c on hv-cinder-85604 Oct 06 12:28:27.097803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-163a1425-9830-4bd8-b352-90872d73cf55 req-5ca6b4ae-47e8-4eef-be2f-166d6df9a2e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084611 Oct 06 12:28:27.098378 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 348/688] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:28:27.209627 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-03deb0ca-f7d1-47de-9b1e-228bea6d1e54 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:27.210261 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-03deb0ca-f7d1-47de-9b1e-228bea6d1e54 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:27.216652 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-03deb0ca-f7d1-47de-9b1e-228bea6d1e54 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:27.217142 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-03deb0ca-f7d1-47de-9b1e-228bea6d1e54 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:27.217574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-03deb0ca-f7d1-47de-9b1e-228bea6d1e54 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:27.218258 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-03deb0ca-f7d1-47de-9b1e-228bea6d1e54 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:27.218709 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-03deb0ca-f7d1-47de-9b1e-228bea6d1e54 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:27.219130 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-03deb0ca-f7d1-47de-9b1e-228bea6d1e54 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:27.220451 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-651c17a4-0a13-44ad-8226-e777a5dbd4f6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:27.221154 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-651c17a4-0a13-44ad-8226-e777a5dbd4f6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:27.227130 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-651c17a4-0a13-44ad-8226-e777a5dbd4f6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:27.227649 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-651c17a4-0a13-44ad-8226-e777a5dbd4f6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:27.228084 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-651c17a4-0a13-44ad-8226-e777a5dbd4f6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:27.228771 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-651c17a4-0a13-44ad-8226-e777a5dbd4f6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:27.229224 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-651c17a4-0a13-44ad-8226-e777a5dbd4f6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:27.229651 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-651c17a4-0a13-44ad-8226-e777a5dbd4f6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:27.413167 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-03deb0ca-f7d1-47de-9b1e-228bea6d1e54 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:27.423766 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-03deb0ca-f7d1-47de-9b1e-228bea6d1e54 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.217906 Oct 06 12:28:27.424459 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 341/689] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:27 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:27.445507 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-651c17a4-0a13-44ad-8226-e777a5dbd4f6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:27.454844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-651c17a4-0a13-44ad-8226-e777a5dbd4f6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:27.456982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-651c17a4-0a13-44ad-8226-e777a5dbd4f6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:27.458355 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-651c17a4-0a13-44ad-8226-e777a5dbd4f6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.242159 Oct 06 12:28:27.459355 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 349/690] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:27 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:27.807242 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-49f77d84-b7d5-4c75-acaf-54e5113b3ade tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:27.807870 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-49f77d84-b7d5-4c75-acaf-54e5113b3ade tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:27.814176 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49f77d84-b7d5-4c75-acaf-54e5113b3ade tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:27.814657 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49f77d84-b7d5-4c75-acaf-54e5113b3ade tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:27.815087 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49f77d84-b7d5-4c75-acaf-54e5113b3ade tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:27.815787 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49f77d84-b7d5-4c75-acaf-54e5113b3ade tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:27.816238 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49f77d84-b7d5-4c75-acaf-54e5113b3ade tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:27.816658 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49f77d84-b7d5-4c75-acaf-54e5113b3ade tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:27.848097 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49f77d84-b7d5-4c75-acaf-54e5113b3ade tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:27.848566 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49f77d84-b7d5-4c75-acaf-54e5113b3ade tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:27.848994 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49f77d84-b7d5-4c75-acaf-54e5113b3ade tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:27.849432 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-49f77d84-b7d5-4c75-acaf-54e5113b3ade tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lazy-loading 'fault' on Instance uuid 7438f9d0-89d0-430c-81bf-867fae34aa5c {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:28:27.890321 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-49f77d84-b7d5-4c75-acaf-54e5113b3ade tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e650801308e4a79b259e239831491e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d5034a312544cd9a1d72439556cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:27.897786 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-49f77d84-b7d5-4c75-acaf-54e5113b3ade tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 200 len: 1309 microversion: 2.1 time: 0.094412 Oct 06 12:28:27.898344 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 342/691] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:27 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:28.449965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7c81c1d8-c868-40c0-a5c6-f131f8aef339 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:28.450608 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7c81c1d8-c868-40c0-a5c6-f131f8aef339 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:28.457044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7c81c1d8-c868-40c0-a5c6-f131f8aef339 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:28.457535 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7c81c1d8-c868-40c0-a5c6-f131f8aef339 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:28.457977 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7c81c1d8-c868-40c0-a5c6-f131f8aef339 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:28.458670 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7c81c1d8-c868-40c0-a5c6-f131f8aef339 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:28.459135 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7c81c1d8-c868-40c0-a5c6-f131f8aef339 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:28.459593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7c81c1d8-c868-40c0-a5c6-f131f8aef339 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:28.484964 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f1ddafb1-77b2-4791-88fc-f17de8201c7b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:28.485581 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f1ddafb1-77b2-4791-88fc-f17de8201c7b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:28.493015 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f1ddafb1-77b2-4791-88fc-f17de8201c7b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:28.493481 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f1ddafb1-77b2-4791-88fc-f17de8201c7b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:28.493797 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f1ddafb1-77b2-4791-88fc-f17de8201c7b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:28.494465 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f1ddafb1-77b2-4791-88fc-f17de8201c7b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:28.494888 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f1ddafb1-77b2-4791-88fc-f17de8201c7b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:28.495621 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f1ddafb1-77b2-4791-88fc-f17de8201c7b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:28.656964 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7c81c1d8-c868-40c0-a5c6-f131f8aef339 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:28.665605 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7c81c1d8-c868-40c0-a5c6-f131f8aef339 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.219403 Oct 06 12:28:28.666206 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 350/692] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:28 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:28.712533 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f1ddafb1-77b2-4791-88fc-f17de8201c7b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:28.722309 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f1ddafb1-77b2-4791-88fc-f17de8201c7b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:28.724033 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f1ddafb1-77b2-4791-88fc-f17de8201c7b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:28.725383 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f1ddafb1-77b2-4791-88fc-f17de8201c7b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.245126 Oct 06 12:28:28.740084 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 343/693] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:28 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:28.921015 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e540de3f-3071-45f4-8896-cb12f16678ee tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:28.921629 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e540de3f-3071-45f4-8896-cb12f16678ee tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] [instance: 7438f9d0-89d0-430c-81bf-867fae34aa5c] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:28.927623 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e540de3f-3071-45f4-8896-cb12f16678ee tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:28.928146 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e540de3f-3071-45f4-8896-cb12f16678ee tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:28.928645 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e540de3f-3071-45f4-8896-cb12f16678ee tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:28.929511 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e540de3f-3071-45f4-8896-cb12f16678ee tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:28.930035 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e540de3f-3071-45f4-8896-cb12f16678ee tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:28.930522 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e540de3f-3071-45f4-8896-cb12f16678ee tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:28.944872 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-e540de3f-3071-45f4-8896-cb12f16678ee tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] HTTP exception thrown: Instance 7438f9d0-89d0-430c-81bf-867fae34aa5c could not be found. Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e540de3f-3071-45f4-8896-cb12f16678ee tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Request method failure captured: Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c HTTP/1.1 Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPsk7uTBosX3bFps59UNuz_cinkvq608C1__DTsQ_ls7hbvkR6zvhekvy7ToOsYfVPnjJbJnRMX869CyUNqNA3FyjWJRZnb8oAV65qVXbsxxMY3WU2ioEbp-DJkILtSVUOiHCwUF27j4u48DF_yDIPygUGh1DtB-bs1l2C2SWmMo_XK0 Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: d2d5034a312544cd9a1d72439556cf41 Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-VolumesSnapshotTestJSON-912460753 Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:28:28.946515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:28:28.948323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2d5034a312544cd9a1d72439556cf41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d2d5034a312544cd9a1d72439556cf41", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2d5034a312544cd9a1d72439556cf41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d2d5034a312544cd9a1d72439556cf41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:28:28.948323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-VolumesSnapshotTestJSON-912460753 Oct 06 12:28:28.948323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: d2d5034a312544cd9a1d72439556cf41 Oct 06 12:28:28.948323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-912460753 Oct 06 12:28:28.948323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-VolumesSnapshotTestJSON-912460753-project Oct 06 12:28:28.948323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:28:28.948323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:28:28.948323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 7e650801308e4a79b259e239831491e3 Oct 06 12:28:28.948323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-VolumesSnapshotTestJSON-912460753-project Oct 06 12:28:28.948323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:28:28.948323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance 7438f9d0-89d0-430c-81bf-867fae34aa5c could not be found. Oct 06 12:28:28.948323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '7438f9d0-89d0-430c-81bf-867fae34aa5c'} Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7438f9d0-89d0-430c-81bf-867fae34aa5c could not be found. Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:28:28.949418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7438f9d0-89d0-430c-81bf-867fae34aa5c could not be found. Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7438f9d0-89d0-430c-81bf-867fae34aa5c could not be found. Oct 06 12:28:28.951111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:28:28.952730 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e540de3f-3071-45f4-8896-cb12f16678ee tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] Returning 404 to user: Instance 7438f9d0-89d0-430c-81bf-867fae34aa5c could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:28:28.952730 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e540de3f-3071-45f4-8896-cb12f16678ee tempest-VolumesSnapshotTestJSON-912460753 tempest-VolumesSnapshotTestJSON-912460753-project] 10.222.0.33 "GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c" status: 404 len: 111 microversion: 2.1 time: 0.031346 Oct 06 12:28:28.952730 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 351/694] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:28 2022] GET /compute/v2.1/servers/7438f9d0-89d0-430c-81bf-867fae34aa5c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:28:29.692624 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9e039272-0670-49ab-8965-d871d97dce6b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:29.693867 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9e039272-0670-49ab-8965-d871d97dce6b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:29.706730 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e039272-0670-49ab-8965-d871d97dce6b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:29.707598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e039272-0670-49ab-8965-d871d97dce6b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:29.708286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e039272-0670-49ab-8965-d871d97dce6b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:29.709164 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e039272-0670-49ab-8965-d871d97dce6b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:29.709617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e039272-0670-49ab-8965-d871d97dce6b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:29.710220 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e039272-0670-49ab-8965-d871d97dce6b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:29.751215 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8aeee4b8-1e5f-454e-9200-c46bc5b544bb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:29.751888 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8aeee4b8-1e5f-454e-9200-c46bc5b544bb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:29.758570 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8aeee4b8-1e5f-454e-9200-c46bc5b544bb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:29.759264 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8aeee4b8-1e5f-454e-9200-c46bc5b544bb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:29.759891 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8aeee4b8-1e5f-454e-9200-c46bc5b544bb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:29.760897 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8aeee4b8-1e5f-454e-9200-c46bc5b544bb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:29.761359 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8aeee4b8-1e5f-454e-9200-c46bc5b544bb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:29.761790 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8aeee4b8-1e5f-454e-9200-c46bc5b544bb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:30.154720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9e039272-0670-49ab-8965-d871d97dce6b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:30.166503 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9e039272-0670-49ab-8965-d871d97dce6b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.477754 Oct 06 12:28:30.171845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 344/695] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:29 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:30.174730 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8aeee4b8-1e5f-454e-9200-c46bc5b544bb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:30.183495 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8aeee4b8-1e5f-454e-9200-c46bc5b544bb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:30.185546 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8aeee4b8-1e5f-454e-9200-c46bc5b544bb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:30.186714 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8aeee4b8-1e5f-454e-9200-c46bc5b544bb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.439953 Oct 06 12:28:30.187457 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 352/696] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:29 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:31.190673 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-6fe3ad64-b136-4950-bd07-e39ae3238517 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:31.191219 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-6fe3ad64-b136-4950-bd07-e39ae3238517 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:31.197704 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fe3ad64-b136-4950-bd07-e39ae3238517 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:31.198190 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fe3ad64-b136-4950-bd07-e39ae3238517 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:31.198682 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fe3ad64-b136-4950-bd07-e39ae3238517 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:31.199320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fe3ad64-b136-4950-bd07-e39ae3238517 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:31.199802 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fe3ad64-b136-4950-bd07-e39ae3238517 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:31.200230 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fe3ad64-b136-4950-bd07-e39ae3238517 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:31.214104 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d7994ec2-b662-4ab1-931e-3f285a52fe34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:31.216885 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d7994ec2-b662-4ab1-931e-3f285a52fe34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:31.225100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d7994ec2-b662-4ab1-931e-3f285a52fe34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:31.225999 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d7994ec2-b662-4ab1-931e-3f285a52fe34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:31.226712 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d7994ec2-b662-4ab1-931e-3f285a52fe34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:31.227885 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d7994ec2-b662-4ab1-931e-3f285a52fe34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:31.228799 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d7994ec2-b662-4ab1-931e-3f285a52fe34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:31.229952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d7994ec2-b662-4ab1-931e-3f285a52fe34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:31.378599 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-6fe3ad64-b136-4950-bd07-e39ae3238517 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:31.387106 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-6fe3ad64-b136-4950-bd07-e39ae3238517 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.200423 Oct 06 12:28:31.388314 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 345/697] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:31 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:31.430245 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d7994ec2-b662-4ab1-931e-3f285a52fe34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:31.440159 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d7994ec2-b662-4ab1-931e-3f285a52fe34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:31.441799 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d7994ec2-b662-4ab1-931e-3f285a52fe34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:31.442989 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d7994ec2-b662-4ab1-931e-3f285a52fe34 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.232689 Oct 06 12:28:31.447745 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 353/698] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:31 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:32.412288 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e2b3cd7f-af2b-4e23-8668-0e786d8d9c59 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:32.412895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e2b3cd7f-af2b-4e23-8668-0e786d8d9c59 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:32.419344 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2b3cd7f-af2b-4e23-8668-0e786d8d9c59 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:32.419854 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2b3cd7f-af2b-4e23-8668-0e786d8d9c59 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:32.420285 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2b3cd7f-af2b-4e23-8668-0e786d8d9c59 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:32.420963 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2b3cd7f-af2b-4e23-8668-0e786d8d9c59 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:32.421411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2b3cd7f-af2b-4e23-8668-0e786d8d9c59 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:32.421833 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2b3cd7f-af2b-4e23-8668-0e786d8d9c59 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:32.470123 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2bb62a89-30d9-402e-8e08-1bde2674a8e6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:32.471131 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2bb62a89-30d9-402e-8e08-1bde2674a8e6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:32.477783 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2bb62a89-30d9-402e-8e08-1bde2674a8e6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:32.478264 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2bb62a89-30d9-402e-8e08-1bde2674a8e6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:32.478696 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2bb62a89-30d9-402e-8e08-1bde2674a8e6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:32.479386 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2bb62a89-30d9-402e-8e08-1bde2674a8e6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:32.479891 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2bb62a89-30d9-402e-8e08-1bde2674a8e6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:32.480312 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2bb62a89-30d9-402e-8e08-1bde2674a8e6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:32.589488 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e2b3cd7f-af2b-4e23-8668-0e786d8d9c59 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:32.597716 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e2b3cd7f-af2b-4e23-8668-0e786d8d9c59 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.189296 Oct 06 12:28:32.598283 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 346/699] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:32 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:28:32.631445 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2bb62a89-30d9-402e-8e08-1bde2674a8e6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:32.640353 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2bb62a89-30d9-402e-8e08-1bde2674a8e6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:32.641788 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2bb62a89-30d9-402e-8e08-1bde2674a8e6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:32.642939 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2bb62a89-30d9-402e-8e08-1bde2674a8e6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.177264 Oct 06 12:28:32.643491 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 354/700] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:32 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:33.622215 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-489d073f-e2a4-4648-b2a0-eaf55cfb60bc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:33.622845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-489d073f-e2a4-4648-b2a0-eaf55cfb60bc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:33.630046 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-489d073f-e2a4-4648-b2a0-eaf55cfb60bc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:33.630705 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-489d073f-e2a4-4648-b2a0-eaf55cfb60bc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:33.631136 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-489d073f-e2a4-4648-b2a0-eaf55cfb60bc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:33.631850 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-489d073f-e2a4-4648-b2a0-eaf55cfb60bc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:33.632297 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-489d073f-e2a4-4648-b2a0-eaf55cfb60bc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:33.632711 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-489d073f-e2a4-4648-b2a0-eaf55cfb60bc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:33.669646 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-932f4274-47a9-4c29-af71-4c567d75c5dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:33.681675 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-932f4274-47a9-4c29-af71-4c567d75c5dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:33.699940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-932f4274-47a9-4c29-af71-4c567d75c5dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:33.700558 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-932f4274-47a9-4c29-af71-4c567d75c5dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:33.701013 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-932f4274-47a9-4c29-af71-4c567d75c5dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:33.701766 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-932f4274-47a9-4c29-af71-4c567d75c5dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:33.702226 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-932f4274-47a9-4c29-af71-4c567d75c5dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:33.702649 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-932f4274-47a9-4c29-af71-4c567d75c5dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:33.832434 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-489d073f-e2a4-4648-b2a0-eaf55cfb60bc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:33.841617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-489d073f-e2a4-4648-b2a0-eaf55cfb60bc tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.223303 Oct 06 12:28:33.842405 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 347/701] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:33 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:33.882843 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-932f4274-47a9-4c29-af71-4c567d75c5dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:33.892626 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-932f4274-47a9-4c29-af71-4c567d75c5dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:33.894062 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-932f4274-47a9-4c29-af71-4c567d75c5dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:33.895223 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-932f4274-47a9-4c29-af71-4c567d75c5dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.230088 Oct 06 12:28:33.895815 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 355/702] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:33 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:34.865250 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b16d3d68-7e67-436c-a100-ccf024e3255b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:34.865853 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b16d3d68-7e67-436c-a100-ccf024e3255b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:34.872795 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b16d3d68-7e67-436c-a100-ccf024e3255b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:34.873267 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b16d3d68-7e67-436c-a100-ccf024e3255b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:34.873690 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b16d3d68-7e67-436c-a100-ccf024e3255b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:34.874362 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b16d3d68-7e67-436c-a100-ccf024e3255b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:34.874817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b16d3d68-7e67-436c-a100-ccf024e3255b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:34.875231 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b16d3d68-7e67-436c-a100-ccf024e3255b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:34.896082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:34.922358 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-08f56f37-5100-47ad-aef4-5ef98356353f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:34.923291 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-08f56f37-5100-47ad-aef4-5ef98356353f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:34.929668 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08f56f37-5100-47ad-aef4-5ef98356353f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:34.930147 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08f56f37-5100-47ad-aef4-5ef98356353f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:34.930577 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08f56f37-5100-47ad-aef4-5ef98356353f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:34.931263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08f56f37-5100-47ad-aef4-5ef98356353f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:34.931738 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08f56f37-5100-47ad-aef4-5ef98356353f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:34.932161 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08f56f37-5100-47ad-aef4-5ef98356353f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:35.058253 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b16d3d68-7e67-436c-a100-ccf024e3255b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:35.066843 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b16d3d68-7e67-436c-a100-ccf024e3255b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.205489 Oct 06 12:28:35.067414 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 348/703] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:34 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:35.086944 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-08f56f37-5100-47ad-aef4-5ef98356353f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:35.095969 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-08f56f37-5100-47ad-aef4-5ef98356353f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:35.097409 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-08f56f37-5100-47ad-aef4-5ef98356353f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:35.098569 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-08f56f37-5100-47ad-aef4-5ef98356353f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.180597 Oct 06 12:28:35.099126 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 356/704] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:34 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:36.090346 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2394ddee-0174-4829-978a-3ad39ee8c423 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:36.090906 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2394ddee-0174-4829-978a-3ad39ee8c423 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:36.097760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2394ddee-0174-4829-978a-3ad39ee8c423 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:36.098637 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2394ddee-0174-4829-978a-3ad39ee8c423 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:36.099376 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2394ddee-0174-4829-978a-3ad39ee8c423 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:36.100763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2394ddee-0174-4829-978a-3ad39ee8c423 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:36.101332 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2394ddee-0174-4829-978a-3ad39ee8c423 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:36.101834 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2394ddee-0174-4829-978a-3ad39ee8c423 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:36.127604 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-098ad864-0a37-46ce-8998-217f94e2ceb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:36.129158 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-098ad864-0a37-46ce-8998-217f94e2ceb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:36.138197 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-098ad864-0a37-46ce-8998-217f94e2ceb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:36.139016 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-098ad864-0a37-46ce-8998-217f94e2ceb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:36.139552 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-098ad864-0a37-46ce-8998-217f94e2ceb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:36.140389 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-098ad864-0a37-46ce-8998-217f94e2ceb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:36.141014 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-098ad864-0a37-46ce-8998-217f94e2ceb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:36.141514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-098ad864-0a37-46ce-8998-217f94e2ceb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:36.317511 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2394ddee-0174-4829-978a-3ad39ee8c423 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:36.328454 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2394ddee-0174-4829-978a-3ad39ee8c423 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.242028 Oct 06 12:28:36.329247 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 349/705] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:36 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:36.331834 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-098ad864-0a37-46ce-8998-217f94e2ceb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:36.342726 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-098ad864-0a37-46ce-8998-217f94e2ceb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:36.344690 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-098ad864-0a37-46ce-8998-217f94e2ceb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:36.346078 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-098ad864-0a37-46ce-8998-217f94e2ceb1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.226523 Oct 06 12:28:36.346807 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 357/706] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:36 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:37.352049 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-66e656a0-7bc2-480e-bc1e-17d3fa42752f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:37.352679 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-66e656a0-7bc2-480e-bc1e-17d3fa42752f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:37.359530 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66e656a0-7bc2-480e-bc1e-17d3fa42752f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:37.360017 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66e656a0-7bc2-480e-bc1e-17d3fa42752f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:37.360446 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66e656a0-7bc2-480e-bc1e-17d3fa42752f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:37.361127 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66e656a0-7bc2-480e-bc1e-17d3fa42752f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:37.361585 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66e656a0-7bc2-480e-bc1e-17d3fa42752f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:37.362006 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66e656a0-7bc2-480e-bc1e-17d3fa42752f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:37.372178 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-47749456-9f04-467f-b21d-e8705207a1f0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:37.372795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-47749456-9f04-467f-b21d-e8705207a1f0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:37.379355 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-47749456-9f04-467f-b21d-e8705207a1f0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:37.379916 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-47749456-9f04-467f-b21d-e8705207a1f0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:37.380353 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-47749456-9f04-467f-b21d-e8705207a1f0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:37.381048 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-47749456-9f04-467f-b21d-e8705207a1f0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:37.381503 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-47749456-9f04-467f-b21d-e8705207a1f0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:37.381926 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-47749456-9f04-467f-b21d-e8705207a1f0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:37.545020 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-66e656a0-7bc2-480e-bc1e-17d3fa42752f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:37.553102 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-66e656a0-7bc2-480e-bc1e-17d3fa42752f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.204939 Oct 06 12:28:37.553671 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 350/707] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:37 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:37.565224 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-47749456-9f04-467f-b21d-e8705207a1f0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:37.573731 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-47749456-9f04-467f-b21d-e8705207a1f0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:37.575162 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-47749456-9f04-467f-b21d-e8705207a1f0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:37.576324 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-47749456-9f04-467f-b21d-e8705207a1f0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.208130 Oct 06 12:28:37.576875 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 358/708] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:37 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:38.578348 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d53fafdc-4ca3-4557-8c49-2234bcb16f42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:38.579452 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d53fafdc-4ca3-4557-8c49-2234bcb16f42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:38.587195 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d53fafdc-4ca3-4557-8c49-2234bcb16f42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:38.587814 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d53fafdc-4ca3-4557-8c49-2234bcb16f42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:38.588375 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d53fafdc-4ca3-4557-8c49-2234bcb16f42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:38.589430 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d53fafdc-4ca3-4557-8c49-2234bcb16f42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:38.590108 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d53fafdc-4ca3-4557-8c49-2234bcb16f42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:38.591120 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d53fafdc-4ca3-4557-8c49-2234bcb16f42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:38.601954 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6eef8ef6-ae5a-4ce3-9056-1561508c1673 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:38.602570 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-6eef8ef6-ae5a-4ce3-9056-1561508c1673 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:38.609579 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6eef8ef6-ae5a-4ce3-9056-1561508c1673 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:38.610069 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6eef8ef6-ae5a-4ce3-9056-1561508c1673 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:38.610506 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6eef8ef6-ae5a-4ce3-9056-1561508c1673 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:38.611210 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6eef8ef6-ae5a-4ce3-9056-1561508c1673 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:38.611703 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6eef8ef6-ae5a-4ce3-9056-1561508c1673 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:38.612133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6eef8ef6-ae5a-4ce3-9056-1561508c1673 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:38.796669 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d53fafdc-4ca3-4557-8c49-2234bcb16f42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:38.808665 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6eef8ef6-ae5a-4ce3-9056-1561508c1673 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:38.810692 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d53fafdc-4ca3-4557-8c49-2234bcb16f42 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.237404 Oct 06 12:28:38.811824 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 351/709] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:38 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:38.829990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6eef8ef6-ae5a-4ce3-9056-1561508c1673 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:38.831448 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6eef8ef6-ae5a-4ce3-9056-1561508c1673 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:38.832798 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-6eef8ef6-ae5a-4ce3-9056-1561508c1673 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.234779 Oct 06 12:28:38.833664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 359/710] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:38 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:39.835072 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b239a377-f349-43d4-92b6-329389f41c30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:39.835698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b239a377-f349-43d4-92b6-329389f41c30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:39.842125 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b239a377-f349-43d4-92b6-329389f41c30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:39.842612 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b239a377-f349-43d4-92b6-329389f41c30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:39.843049 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b239a377-f349-43d4-92b6-329389f41c30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:39.843764 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b239a377-f349-43d4-92b6-329389f41c30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:39.844222 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b239a377-f349-43d4-92b6-329389f41c30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:39.844651 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b239a377-f349-43d4-92b6-329389f41c30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:39.858245 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e568508e-235d-4cf2-ad3c-6b4f94146e63 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:39.858882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e568508e-235d-4cf2-ad3c-6b4f94146e63 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:39.861446 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:39.866537 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e568508e-235d-4cf2-ad3c-6b4f94146e63 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:39.867021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e568508e-235d-4cf2-ad3c-6b4f94146e63 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:39.867464 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e568508e-235d-4cf2-ad3c-6b4f94146e63 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:39.868214 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e568508e-235d-4cf2-ad3c-6b4f94146e63 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:39.868695 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e568508e-235d-4cf2-ad3c-6b4f94146e63 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:39.869104 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e568508e-235d-4cf2-ad3c-6b4f94146e63 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:40.067814 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b239a377-f349-43d4-92b6-329389f41c30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:40.072125 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e568508e-235d-4cf2-ad3c-6b4f94146e63 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:40.084444 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b239a377-f349-43d4-92b6-329389f41c30 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.253129 Oct 06 12:28:40.085068 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 352/711] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:39 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:40.100951 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e568508e-235d-4cf2-ad3c-6b4f94146e63 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:40.100951 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e568508e-235d-4cf2-ad3c-6b4f94146e63 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:40.100951 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e568508e-235d-4cf2-ad3c-6b4f94146e63 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.233839 Oct 06 12:28:40.107116 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 360/712] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:39 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:41.110308 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3d67d7cf-7b94-40ff-866d-b1a2a24913d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:41.111036 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3d67d7cf-7b94-40ff-866d-b1a2a24913d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:41.113550 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=54 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:41.114465 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c20c6f6e-664c-4adf-8513-9e0b63a6f6ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:41.115104 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c20c6f6e-664c-4adf-8513-9e0b63a6f6ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:41.120578 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d67d7cf-7b94-40ff-866d-b1a2a24913d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:41.121193 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d67d7cf-7b94-40ff-866d-b1a2a24913d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:41.121631 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d67d7cf-7b94-40ff-866d-b1a2a24913d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:41.121870 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c20c6f6e-664c-4adf-8513-9e0b63a6f6ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:41.122336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d67d7cf-7b94-40ff-866d-b1a2a24913d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:41.122446 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c20c6f6e-664c-4adf-8513-9e0b63a6f6ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:41.123272 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c20c6f6e-664c-4adf-8513-9e0b63a6f6ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:41.123379 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d67d7cf-7b94-40ff-866d-b1a2a24913d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:41.123739 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d67d7cf-7b94-40ff-866d-b1a2a24913d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:41.124155 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c20c6f6e-664c-4adf-8513-9e0b63a6f6ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:41.124688 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c20c6f6e-664c-4adf-8513-9e0b63a6f6ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:41.125175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c20c6f6e-664c-4adf-8513-9e0b63a6f6ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:41.129318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:41.332835 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3d67d7cf-7b94-40ff-866d-b1a2a24913d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:41.336248 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c20c6f6e-664c-4adf-8513-9e0b63a6f6ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:41.345282 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3d67d7cf-7b94-40ff-866d-b1a2a24913d3 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.238697 Oct 06 12:28:41.346094 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 353/713] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:41 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:41.346582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c20c6f6e-664c-4adf-8513-9e0b63a6f6ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:41.348416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c20c6f6e-664c-4adf-8513-9e0b63a6f6ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:41.349827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c20c6f6e-664c-4adf-8513-9e0b63a6f6ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.239765 Oct 06 12:28:41.351035 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 361/714] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:41 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:41.988449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3b054083-979b-47d0-a7d1-a61b5a53a50f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:41.988945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3b054083-979b-47d0-a7d1-a61b5a53a50f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:41.995305 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3b054083-979b-47d0-a7d1-a61b5a53a50f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:41.995918 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3b054083-979b-47d0-a7d1-a61b5a53a50f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:41.996357 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3b054083-979b-47d0-a7d1-a61b5a53a50f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:41.997061 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3b054083-979b-47d0-a7d1-a61b5a53a50f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:41.997514 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3b054083-979b-47d0-a7d1-a61b5a53a50f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:41.997941 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3b054083-979b-47d0-a7d1-a61b5a53a50f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:42.084817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-3b054083-979b-47d0-a7d1-a61b5a53a50f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lazy-loading 'services' on Instance uuid b7c26e82-69b3-4ffa-97e2-7ca36b941c1f {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:28:42.169073 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3b054083-979b-47d0-a7d1-a61b5a53a50f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/os-volume_attachments/b2946d72-c741-4e47-af0b-d2e50d835a42" status: 202 len: 0 microversion: 2.1 time: 0.290162 Oct 06 12:28:42.170363 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 354/715] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 12:28:41 2022] DELETE /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/os-volume_attachments/b2946d72-c741-4e47-af0b-d2e50d835a42 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:28:42.368446 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-05cf0c18-084e-4454-ba16-b69355bf9c41 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:42.369122 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-05cf0c18-084e-4454-ba16-b69355bf9c41 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:42.375784 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-05cf0c18-084e-4454-ba16-b69355bf9c41 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:42.376276 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-05cf0c18-084e-4454-ba16-b69355bf9c41 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:42.376726 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-05cf0c18-084e-4454-ba16-b69355bf9c41 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:42.376851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3dc879db-72e8-48da-8853-20263a99b600 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:42.377394 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-05cf0c18-084e-4454-ba16-b69355bf9c41 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:42.377585 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3dc879db-72e8-48da-8853-20263a99b600 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:42.377870 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-05cf0c18-084e-4454-ba16-b69355bf9c41 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:42.378289 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-05cf0c18-084e-4454-ba16-b69355bf9c41 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:42.383878 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3dc879db-72e8-48da-8853-20263a99b600 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:42.384359 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3dc879db-72e8-48da-8853-20263a99b600 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:42.384797 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3dc879db-72e8-48da-8853-20263a99b600 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:42.385478 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3dc879db-72e8-48da-8853-20263a99b600 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:42.385931 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3dc879db-72e8-48da-8853-20263a99b600 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:42.386351 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3dc879db-72e8-48da-8853-20263a99b600 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:42.579637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-05cf0c18-084e-4454-ba16-b69355bf9c41 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:42.586569 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3dc879db-72e8-48da-8853-20263a99b600 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:42.589575 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-05cf0c18-084e-4454-ba16-b69355bf9c41 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.225003 Oct 06 12:28:42.590165 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 362/716] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:42 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:42.605937 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3dc879db-72e8-48da-8853-20263a99b600 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:42.607414 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3dc879db-72e8-48da-8853-20263a99b600 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:42.608607 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3dc879db-72e8-48da-8853-20263a99b600 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.235977 Oct 06 12:28:42.609159 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 355/717] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:42 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:43.613644 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-32286e83-6893-4c86-9c1e-10a2df16af12 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:43.614296 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-32286e83-6893-4c86-9c1e-10a2df16af12 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:43.620655 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32286e83-6893-4c86-9c1e-10a2df16af12 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:43.621144 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32286e83-6893-4c86-9c1e-10a2df16af12 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:43.621580 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32286e83-6893-4c86-9c1e-10a2df16af12 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:43.622290 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32286e83-6893-4c86-9c1e-10a2df16af12 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:43.622782 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32286e83-6893-4c86-9c1e-10a2df16af12 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:43.623208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32286e83-6893-4c86-9c1e-10a2df16af12 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:43.634242 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c2ccf827-64b8-492e-adee-cff6a9a31576 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:43.634849 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c2ccf827-64b8-492e-adee-cff6a9a31576 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:43.641198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2ccf827-64b8-492e-adee-cff6a9a31576 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:43.641677 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2ccf827-64b8-492e-adee-cff6a9a31576 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:43.642107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2ccf827-64b8-492e-adee-cff6a9a31576 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:43.642792 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2ccf827-64b8-492e-adee-cff6a9a31576 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:43.643242 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2ccf827-64b8-492e-adee-cff6a9a31576 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:43.643692 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c2ccf827-64b8-492e-adee-cff6a9a31576 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:43.818594 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-32286e83-6893-4c86-9c1e-10a2df16af12 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:43.825317 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c2ccf827-64b8-492e-adee-cff6a9a31576 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:43.828333 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-32286e83-6893-4c86-9c1e-10a2df16af12 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.218493 Oct 06 12:28:43.828946 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 363/718] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:43 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:43.834443 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c2ccf827-64b8-492e-adee-cff6a9a31576 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:43.836014 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c2ccf827-64b8-492e-adee-cff6a9a31576 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:43.837239 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c2ccf827-64b8-492e-adee-cff6a9a31576 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.207008 Oct 06 12:28:43.838043 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 356/719] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:43 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:44.851800 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-56870075-f68e-449a-9bf9-8630562373eb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:44.852427 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-56870075-f68e-449a-9bf9-8630562373eb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:44.859415 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-56870075-f68e-449a-9bf9-8630562373eb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:44.859935 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-56870075-f68e-449a-9bf9-8630562373eb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:44.860373 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-56870075-f68e-449a-9bf9-8630562373eb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:44.861070 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-56870075-f68e-449a-9bf9-8630562373eb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:44.861534 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-56870075-f68e-449a-9bf9-8630562373eb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:44.861962 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-56870075-f68e-449a-9bf9-8630562373eb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:44.862629 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-6868b3c3-03ed-411e-8c38-bab7544539a2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:44.863226 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-6868b3c3-03ed-411e-8c38-bab7544539a2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:44.869486 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6868b3c3-03ed-411e-8c38-bab7544539a2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:44.869959 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6868b3c3-03ed-411e-8c38-bab7544539a2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:44.870381 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6868b3c3-03ed-411e-8c38-bab7544539a2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:44.871057 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6868b3c3-03ed-411e-8c38-bab7544539a2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:44.871497 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6868b3c3-03ed-411e-8c38-bab7544539a2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:44.871942 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6868b3c3-03ed-411e-8c38-bab7544539a2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:45.054179 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-56870075-f68e-449a-9bf9-8630562373eb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:45.057477 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-6868b3c3-03ed-411e-8c38-bab7544539a2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:45.062979 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-56870075-f68e-449a-9bf9-8630562373eb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.215063 Oct 06 12:28:45.063767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 364/720] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:44 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:45.066887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-6868b3c3-03ed-411e-8c38-bab7544539a2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:45.068371 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-6868b3c3-03ed-411e-8c38-bab7544539a2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:45.069519 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-6868b3c3-03ed-411e-8c38-bab7544539a2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.210735 Oct 06 12:28:45.070074 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 357/721] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:44 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:46.087488 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-67354d07-5e12-40f3-b1fa-24fd22ce440d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:46.088197 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-67354d07-5e12-40f3-b1fa-24fd22ce440d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:46.095182 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67354d07-5e12-40f3-b1fa-24fd22ce440d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:46.095703 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67354d07-5e12-40f3-b1fa-24fd22ce440d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:46.095838 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c3bb476f-260e-4367-9863-ce02128b15da tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:46.096299 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67354d07-5e12-40f3-b1fa-24fd22ce440d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:46.096408 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c3bb476f-260e-4367-9863-ce02128b15da tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:46.096801 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67354d07-5e12-40f3-b1fa-24fd22ce440d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:46.097252 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67354d07-5e12-40f3-b1fa-24fd22ce440d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:46.097670 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-67354d07-5e12-40f3-b1fa-24fd22ce440d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:46.102758 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c3bb476f-260e-4367-9863-ce02128b15da tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:46.103242 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c3bb476f-260e-4367-9863-ce02128b15da tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:46.103709 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c3bb476f-260e-4367-9863-ce02128b15da tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:46.104401 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c3bb476f-260e-4367-9863-ce02128b15da tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:46.104880 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c3bb476f-260e-4367-9863-ce02128b15da tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:46.105307 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c3bb476f-260e-4367-9863-ce02128b15da tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:46.304560 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-67354d07-5e12-40f3-b1fa-24fd22ce440d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:46.312453 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c3bb476f-260e-4367-9863-ce02128b15da tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:46.313379 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-67354d07-5e12-40f3-b1fa-24fd22ce440d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.229685 Oct 06 12:28:46.313965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 365/722] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:46 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:46.321170 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c3bb476f-260e-4367-9863-ce02128b15da tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:46.322605 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c3bb476f-260e-4367-9863-ce02128b15da tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:46.323776 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c3bb476f-260e-4367-9863-ce02128b15da tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.232423 Oct 06 12:28:46.324351 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 358/723] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:46 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:47.336502 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c5ed8c58-7f4a-427f-b7d0-fabcbf814e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:47.337098 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c5ed8c58-7f4a-427f-b7d0-fabcbf814e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:47.344077 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c5ed8c58-7f4a-427f-b7d0-fabcbf814e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:47.344560 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c5ed8c58-7f4a-427f-b7d0-fabcbf814e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:47.344996 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c5ed8c58-7f4a-427f-b7d0-fabcbf814e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:47.345686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c5ed8c58-7f4a-427f-b7d0-fabcbf814e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:47.346141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c5ed8c58-7f4a-427f-b7d0-fabcbf814e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:47.346561 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c5ed8c58-7f4a-427f-b7d0-fabcbf814e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:47.348852 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-85094d73-a00a-482e-8aee-191fef56dc4a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:47.349454 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-85094d73-a00a-482e-8aee-191fef56dc4a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:47.355568 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-85094d73-a00a-482e-8aee-191fef56dc4a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:47.356044 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-85094d73-a00a-482e-8aee-191fef56dc4a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:47.356478 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-85094d73-a00a-482e-8aee-191fef56dc4a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:47.357197 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-85094d73-a00a-482e-8aee-191fef56dc4a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:47.357649 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-85094d73-a00a-482e-8aee-191fef56dc4a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:47.358073 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-85094d73-a00a-482e-8aee-191fef56dc4a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:47.541162 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c5ed8c58-7f4a-427f-b7d0-fabcbf814e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:47.543963 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-85094d73-a00a-482e-8aee-191fef56dc4a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:47.549380 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c5ed8c58-7f4a-427f-b7d0-fabcbf814e78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.216768 Oct 06 12:28:47.549951 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 366/724] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:47 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:47.552467 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-85094d73-a00a-482e-8aee-191fef56dc4a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:47.553907 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-85094d73-a00a-482e-8aee-191fef56dc4a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:47.555047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-85094d73-a00a-482e-8aee-191fef56dc4a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.210124 Oct 06 12:28:47.555611 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 359/725] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:47 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:48.583904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-04ddf8e3-4d64-4782-a325-5b3d6351a7d1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:48.583904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-04ddf8e3-4d64-4782-a325-5b3d6351a7d1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:48.583904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-04ddf8e3-4d64-4782-a325-5b3d6351a7d1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:48.583904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-04ddf8e3-4d64-4782-a325-5b3d6351a7d1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:48.584618 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-04ddf8e3-4d64-4782-a325-5b3d6351a7d1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:48.584618 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-04ddf8e3-4d64-4782-a325-5b3d6351a7d1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:48.584618 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-04ddf8e3-4d64-4782-a325-5b3d6351a7d1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:48.584618 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-04ddf8e3-4d64-4782-a325-5b3d6351a7d1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:48.588198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-6066b453-1ef7-4f62-9df2-b7b108442b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:48.588887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-6066b453-1ef7-4f62-9df2-b7b108442b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:48.595398 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6066b453-1ef7-4f62-9df2-b7b108442b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:48.595922 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6066b453-1ef7-4f62-9df2-b7b108442b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:48.596358 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6066b453-1ef7-4f62-9df2-b7b108442b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:48.597084 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6066b453-1ef7-4f62-9df2-b7b108442b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:48.597541 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6066b453-1ef7-4f62-9df2-b7b108442b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:48.598105 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6066b453-1ef7-4f62-9df2-b7b108442b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:48.786430 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-6066b453-1ef7-4f62-9df2-b7b108442b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:48.789555 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-04ddf8e3-4d64-4782-a325-5b3d6351a7d1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:48.796221 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-6066b453-1ef7-4f62-9df2-b7b108442b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:48.797674 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-6066b453-1ef7-4f62-9df2-b7b108442b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:48.798239 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-04ddf8e3-4d64-4782-a325-5b3d6351a7d1 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.229535 Oct 06 12:28:48.798803 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-6066b453-1ef7-4f62-9df2-b7b108442b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.223017 Oct 06 12:28:48.799104 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 367/726] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:48 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:28:48.799355 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 360/727] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:48 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:49.821770 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f2c7554e-84eb-4a77-aeea-f31acb30670f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:49.822383 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f2c7554e-84eb-4a77-aeea-f31acb30670f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:49.823887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-20de0e1b-e567-4d27-9d91-4225fae195fa tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:49.824495 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-20de0e1b-e567-4d27-9d91-4225fae195fa tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:49.828768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f2c7554e-84eb-4a77-aeea-f31acb30670f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:49.829257 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f2c7554e-84eb-4a77-aeea-f31acb30670f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:49.829695 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f2c7554e-84eb-4a77-aeea-f31acb30670f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:49.830387 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f2c7554e-84eb-4a77-aeea-f31acb30670f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:49.830696 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-20de0e1b-e567-4d27-9d91-4225fae195fa tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:49.830839 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f2c7554e-84eb-4a77-aeea-f31acb30670f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:49.831177 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-20de0e1b-e567-4d27-9d91-4225fae195fa tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:49.831298 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f2c7554e-84eb-4a77-aeea-f31acb30670f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:49.831643 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-20de0e1b-e567-4d27-9d91-4225fae195fa tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:49.832329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-20de0e1b-e567-4d27-9d91-4225fae195fa tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:49.832773 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-20de0e1b-e567-4d27-9d91-4225fae195fa tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:49.833198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-20de0e1b-e567-4d27-9d91-4225fae195fa tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:50.023042 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f2c7554e-84eb-4a77-aeea-f31acb30670f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:50.026469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-20de0e1b-e567-4d27-9d91-4225fae195fa tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:50.031631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f2c7554e-84eb-4a77-aeea-f31acb30670f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.213620 Oct 06 12:28:50.032216 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 368/728] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:49 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:50.034937 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-20de0e1b-e567-4d27-9d91-4225fae195fa tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:50.036545 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-20de0e1b-e567-4d27-9d91-4225fae195fa tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:50.037688 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-20de0e1b-e567-4d27-9d91-4225fae195fa tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.217788 Oct 06 12:28:50.038243 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 361/729] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:49 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:51.062564 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-fc1f674d-8335-4490-ba6b-c3cef9596928 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:51.063152 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-64a831eb-fa76-423e-b9f9-6b075a97d181 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:51.063547 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-fc1f674d-8335-4490-ba6b-c3cef9596928 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:51.063662 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-64a831eb-fa76-423e-b9f9-6b075a97d181 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:51.069606 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fc1f674d-8335-4490-ba6b-c3cef9596928 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:51.069767 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64a831eb-fa76-423e-b9f9-6b075a97d181 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:51.070094 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fc1f674d-8335-4490-ba6b-c3cef9596928 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:51.070215 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64a831eb-fa76-423e-b9f9-6b075a97d181 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:51.070531 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fc1f674d-8335-4490-ba6b-c3cef9596928 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:51.070637 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64a831eb-fa76-423e-b9f9-6b075a97d181 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:51.071204 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64a831eb-fa76-423e-b9f9-6b075a97d181 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:51.071304 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fc1f674d-8335-4490-ba6b-c3cef9596928 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:51.071773 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64a831eb-fa76-423e-b9f9-6b075a97d181 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:51.071929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fc1f674d-8335-4490-ba6b-c3cef9596928 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:51.072319 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64a831eb-fa76-423e-b9f9-6b075a97d181 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:51.072509 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fc1f674d-8335-4490-ba6b-c3cef9596928 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:51.265253 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-fc1f674d-8335-4490-ba6b-c3cef9596928 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:51.269195 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-64a831eb-fa76-423e-b9f9-6b075a97d181 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:51.273643 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-fc1f674d-8335-4490-ba6b-c3cef9596928 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.214843 Oct 06 12:28:51.274220 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 369/730] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:51 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:51.279549 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-64a831eb-fa76-423e-b9f9-6b075a97d181 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:51.281193 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-64a831eb-fa76-423e-b9f9-6b075a97d181 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:51.282824 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-64a831eb-fa76-423e-b9f9-6b075a97d181 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.224054 Oct 06 12:28:51.283549 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 362/731] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:51 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:52.297911 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-24209321-0c3f-4345-92d8-9ae2622fef6d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:52.298522 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-24209321-0c3f-4345-92d8-9ae2622fef6d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:52.304909 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-24209321-0c3f-4345-92d8-9ae2622fef6d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:52.305393 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-24209321-0c3f-4345-92d8-9ae2622fef6d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:52.305831 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-24209321-0c3f-4345-92d8-9ae2622fef6d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:52.306526 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-24209321-0c3f-4345-92d8-9ae2622fef6d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:52.306983 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-24209321-0c3f-4345-92d8-9ae2622fef6d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:52.307106 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-cb4ddba1-6eba-441c-beca-73745f971ed5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:52.307539 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-24209321-0c3f-4345-92d8-9ae2622fef6d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:52.307641 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-cb4ddba1-6eba-441c-beca-73745f971ed5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:52.313675 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cb4ddba1-6eba-441c-beca-73745f971ed5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:52.314159 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cb4ddba1-6eba-441c-beca-73745f971ed5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:52.314593 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cb4ddba1-6eba-441c-beca-73745f971ed5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:52.315281 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cb4ddba1-6eba-441c-beca-73745f971ed5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:52.315758 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cb4ddba1-6eba-441c-beca-73745f971ed5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:52.316186 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cb4ddba1-6eba-441c-beca-73745f971ed5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:52.496414 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-24209321-0c3f-4345-92d8-9ae2622fef6d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:52.499530 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-cb4ddba1-6eba-441c-beca-73745f971ed5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:52.504471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-24209321-0c3f-4345-92d8-9ae2622fef6d tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.211028 Oct 06 12:28:52.505047 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 370/732] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:52 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:52.508230 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-cb4ddba1-6eba-441c-beca-73745f971ed5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:52.509717 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-cb4ddba1-6eba-441c-beca-73745f971ed5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:52.510865 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-cb4ddba1-6eba-441c-beca-73745f971ed5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.207693 Oct 06 12:28:52.511408 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 363/733] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:52 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:52.826657 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c73c7653-86b5-4559-aea3-5c846ce17fad tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:28:52.832907 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c73c7653-86b5-4559-aea3-5c846ce17fad tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:52.833483 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c73c7653-86b5-4559-aea3-5c846ce17fad tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:52.834076 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c73c7653-86b5-4559-aea3-5c846ce17fad tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:52.857172 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c73c7653-86b5-4559-aea3-5c846ce17fad tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Going to try to stop instance {{(pid=120508) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 12:28:52.897988 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c73c7653-86b5-4559-aea3-5c846ce17fad tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "POST /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/action" status: 202 len: 0 microversion: 2.1 time: 0.075813 Oct 06 12:28:52.898589 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 371/734] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 12:28:52 2022] POST /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:28:52.907676 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-037cc09c-6ee6-451a-83b2-d2ba82a997ba tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:52.908291 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-037cc09c-6ee6-451a-83b2-d2ba82a997ba tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:52.914184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-037cc09c-6ee6-451a-83b2-d2ba82a997ba tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:52.914671 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-037cc09c-6ee6-451a-83b2-d2ba82a997ba tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:52.915115 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-037cc09c-6ee6-451a-83b2-d2ba82a997ba tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:52.915840 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-037cc09c-6ee6-451a-83b2-d2ba82a997ba tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:52.916296 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-037cc09c-6ee6-451a-83b2-d2ba82a997ba tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:52.916727 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-037cc09c-6ee6-451a-83b2-d2ba82a997ba tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:52.935948 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:53.050643 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-037cc09c-6ee6-451a-83b2-d2ba82a997ba tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:53.059585 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-037cc09c-6ee6-451a-83b2-d2ba82a997ba tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1724 microversion: 2.1 time: 0.156349 Oct 06 12:28:53.061246 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 364/735] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:52 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:28:53.531544 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-affca262-5750-4e5a-810a-164528ad45fb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:53.531544 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-affca262-5750-4e5a-810a-164528ad45fb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:53.539389 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-affca262-5750-4e5a-810a-164528ad45fb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:53.539711 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-347014b5-faa6-40cb-85ce-25dd7eea5704 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:53.540155 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-affca262-5750-4e5a-810a-164528ad45fb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:53.540276 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-347014b5-faa6-40cb-85ce-25dd7eea5704 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:53.540372 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-affca262-5750-4e5a-810a-164528ad45fb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:53.541042 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-affca262-5750-4e5a-810a-164528ad45fb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:53.541703 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-affca262-5750-4e5a-810a-164528ad45fb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:53.542135 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-affca262-5750-4e5a-810a-164528ad45fb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:53.547456 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-347014b5-faa6-40cb-85ce-25dd7eea5704 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:53.547980 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-347014b5-faa6-40cb-85ce-25dd7eea5704 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:53.548456 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-347014b5-faa6-40cb-85ce-25dd7eea5704 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:53.549151 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-347014b5-faa6-40cb-85ce-25dd7eea5704 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:53.549785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-347014b5-faa6-40cb-85ce-25dd7eea5704 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:53.550209 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-347014b5-faa6-40cb-85ce-25dd7eea5704 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:53.751762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-affca262-5750-4e5a-810a-164528ad45fb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:53.755020 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-347014b5-faa6-40cb-85ce-25dd7eea5704 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:53.760468 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-affca262-5750-4e5a-810a-164528ad45fb tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.235386 Oct 06 12:28:53.761276 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 372/736] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:53 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:53.765113 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-347014b5-faa6-40cb-85ce-25dd7eea5704 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:53.766894 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-347014b5-faa6-40cb-85ce-25dd7eea5704 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:53.768302 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-347014b5-faa6-40cb-85ce-25dd7eea5704 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.232710 Oct 06 12:28:53.769086 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 365/737] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:53 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:54.086322 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5abb800e-7c62-45c6-8552-f7596acd53fe tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:54.086848 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5abb800e-7c62-45c6-8552-f7596acd53fe tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:54.093711 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5abb800e-7c62-45c6-8552-f7596acd53fe tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:54.094189 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5abb800e-7c62-45c6-8552-f7596acd53fe tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:54.094620 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5abb800e-7c62-45c6-8552-f7596acd53fe tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:54.095295 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5abb800e-7c62-45c6-8552-f7596acd53fe tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:54.095779 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5abb800e-7c62-45c6-8552-f7596acd53fe tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:54.096199 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5abb800e-7c62-45c6-8552-f7596acd53fe tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:54.222500 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5abb800e-7c62-45c6-8552-f7596acd53fe tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:54.230133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5abb800e-7c62-45c6-8552-f7596acd53fe tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1678 microversion: 2.1 time: 0.147741 Oct 06 12:28:54.230700 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 373/738] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:54 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:54.784766 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4795fa5d-ed60-49b4-be2b-662e335b9cda tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:54.785377 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4795fa5d-ed60-49b4-be2b-662e335b9cda tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:54.792128 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4795fa5d-ed60-49b4-be2b-662e335b9cda tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:54.792605 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4795fa5d-ed60-49b4-be2b-662e335b9cda tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:54.793030 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4795fa5d-ed60-49b4-be2b-662e335b9cda tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:54.793711 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4795fa5d-ed60-49b4-be2b-662e335b9cda tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:54.794065 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9f2993e7-0317-478a-8edc-45a2523acbfc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:54.794475 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4795fa5d-ed60-49b4-be2b-662e335b9cda tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:54.794590 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4795fa5d-ed60-49b4-be2b-662e335b9cda tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:54.794672 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9f2993e7-0317-478a-8edc-45a2523acbfc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:54.801783 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9f2993e7-0317-478a-8edc-45a2523acbfc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:54.802251 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9f2993e7-0317-478a-8edc-45a2523acbfc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:54.802686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9f2993e7-0317-478a-8edc-45a2523acbfc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:54.803378 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9f2993e7-0317-478a-8edc-45a2523acbfc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:54.803866 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9f2993e7-0317-478a-8edc-45a2523acbfc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:54.804293 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9f2993e7-0317-478a-8edc-45a2523acbfc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:54.986804 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4795fa5d-ed60-49b4-be2b-662e335b9cda tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:54.995196 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4795fa5d-ed60-49b4-be2b-662e335b9cda tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1733 microversion: 2.1 time: 0.214294 Oct 06 12:28:54.996012 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 366/739] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:54 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:54.996145 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9f2993e7-0317-478a-8edc-45a2523acbfc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:55.007886 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9f2993e7-0317-478a-8edc-45a2523acbfc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:55.009610 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9f2993e7-0317-478a-8edc-45a2523acbfc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:55.010920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9f2993e7-0317-478a-8edc-45a2523acbfc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.220717 Oct 06 12:28:55.011485 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 374/740] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:54 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:55.254329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c42b4424-9fba-44e0-affb-b934dbbf8bfc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:55.255106 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c42b4424-9fba-44e0-affb-b934dbbf8bfc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:55.261923 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c42b4424-9fba-44e0-affb-b934dbbf8bfc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:55.262402 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c42b4424-9fba-44e0-affb-b934dbbf8bfc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:55.262832 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c42b4424-9fba-44e0-affb-b934dbbf8bfc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:55.263557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c42b4424-9fba-44e0-affb-b934dbbf8bfc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:55.264010 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c42b4424-9fba-44e0-affb-b934dbbf8bfc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:55.264430 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c42b4424-9fba-44e0-affb-b934dbbf8bfc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:55.392668 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c42b4424-9fba-44e0-affb-b934dbbf8bfc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:55.400881 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c42b4424-9fba-44e0-affb-b934dbbf8bfc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1678 microversion: 2.1 time: 0.150719 Oct 06 12:28:55.401464 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 367/741] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:55 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:56.018801 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-559fac2b-be2d-4f9b-a07a-3f746bbb3163 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:56.019455 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-559fac2b-be2d-4f9b-a07a-3f746bbb3163 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:56.025992 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-559fac2b-be2d-4f9b-a07a-3f746bbb3163 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:56.026476 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-559fac2b-be2d-4f9b-a07a-3f746bbb3163 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:56.026910 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-559fac2b-be2d-4f9b-a07a-3f746bbb3163 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:56.027631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-559fac2b-be2d-4f9b-a07a-3f746bbb3163 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:56.028093 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-559fac2b-be2d-4f9b-a07a-3f746bbb3163 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:56.028549 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-559fac2b-be2d-4f9b-a07a-3f746bbb3163 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:56.037223 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-66454794-2fa3-42bc-a7bf-2cf1d59529cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:56.037829 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-66454794-2fa3-42bc-a7bf-2cf1d59529cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:56.044055 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66454794-2fa3-42bc-a7bf-2cf1d59529cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:56.044535 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66454794-2fa3-42bc-a7bf-2cf1d59529cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:56.044966 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66454794-2fa3-42bc-a7bf-2cf1d59529cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:56.045651 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66454794-2fa3-42bc-a7bf-2cf1d59529cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:56.046100 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66454794-2fa3-42bc-a7bf-2cf1d59529cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:56.046528 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-66454794-2fa3-42bc-a7bf-2cf1d59529cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:56.230751 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-559fac2b-be2d-4f9b-a07a-3f746bbb3163 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:56.236076 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-66454794-2fa3-42bc-a7bf-2cf1d59529cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:56.240395 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-559fac2b-be2d-4f9b-a07a-3f746bbb3163 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1713 microversion: 2.1 time: 0.225353 Oct 06 12:28:56.241053 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 375/742] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:56 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1713 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:56.251069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-66454794-2fa3-42bc-a7bf-2cf1d59529cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:56.252594 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-66454794-2fa3-42bc-a7bf-2cf1d59529cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:56.253715 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-66454794-2fa3-42bc-a7bf-2cf1d59529cf tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.220391 Oct 06 12:28:56.259545 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 368/743] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:56 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:28:56.312316 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0e1a1dc5-09f5-4e99-a37c-5ae5138811f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:56.312810 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-0e1a1dc5-09f5-4e99-a37c-5ae5138811f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:56.318923 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0e1a1dc5-09f5-4e99-a37c-5ae5138811f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:56.319456 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0e1a1dc5-09f5-4e99-a37c-5ae5138811f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:56.319926 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0e1a1dc5-09f5-4e99-a37c-5ae5138811f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:56.320675 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0e1a1dc5-09f5-4e99-a37c-5ae5138811f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:56.321164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0e1a1dc5-09f5-4e99-a37c-5ae5138811f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:56.321592 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0e1a1dc5-09f5-4e99-a37c-5ae5138811f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:56.397478 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:56.402734 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-0e1a1dc5-09f5-4e99-a37c-5ae5138811f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] HTTP exception thrown: Cannot 'detach_volume' instance 1620fb3a-f872-41f2-83d2-909fbe71f438 while it is in vm_state rescued Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0e1a1dc5-09f5-4e99-a37c-5ae5138811f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Request method failure captured: Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: DELETE /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-volume_attachments/0285b46f-880e-40e1-b475-20d785de50ba HTTP/1.1 Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPsh-PJ9xvBXdfQe_7UormM1Qyx0qepQqe1wI78PUDz3eEOb52qjqvlvg_d8nEkHrVtXCoBdXqhuEix6aY08jzJfIy6nrnz7MkzwZ2sOKibXZ2ZU4L1xUu_NrfA_ABN8p0EemOJk_E32lA71Qz_KuMtDmQk38cZgrdfRfT30A7Fp6Ci4 Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: 9138bc89f5204975a18156097530643a Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-754252330 Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:28:56.404365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:28:56.405998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9138bc89f5204975a18156097530643a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9138bc89f5204975a18156097530643a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9138bc89f5204975a18156097530643a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9138bc89f5204975a18156097530643a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:28:56.405998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-ServerRescueNegativeTestJSON-754252330 Oct 06 12:28:56.405998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: 9138bc89f5204975a18156097530643a Oct 06 12:28:56.405998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-754252330 Oct 06 12:28:56.405998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-ServerRescueNegativeTestJSON-754252330-project Oct 06 12:28:56.405998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:28:56.405998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:28:56.405998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 1f4cbe342b2c4378b3c0ab2f1cd55260 Oct 06 12:28:56.405998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-ServerRescueNegativeTestJSON-754252330-project Oct 06 12:28:56.405998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:28:56.405998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Cannot 'detach_volume' instance 1620fb3a-f872-41f2-83d2-909fbe71f438 while it is in vm_state rescued Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'server_id': '1620fb3a-f872-41f2-83d2-909fbe71f438', 'id': '0285b46f-880e-40e1-b475-20d785de50ba'} Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1620fb3a-f872-41f2-83d2-909fbe71f438 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:28:56.406827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1620fb3a-f872-41f2-83d2-909fbe71f438 while it is in vm_state rescued Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1620fb3a-f872-41f2-83d2-909fbe71f438 while it is in vm_state rescued Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:28:56.408362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0e1a1dc5-09f5-4e99-a37c-5ae5138811f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Returning 409 to user: Cannot 'detach_volume' instance 1620fb3a-f872-41f2-83d2-909fbe71f438 while it is in vm_state rescued {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:28:56.409816 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-0e1a1dc5-09f5-4e99-a37c-5ae5138811f2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-volume_attachments/0285b46f-880e-40e1-b475-20d785de50ba" status: 409 len: 152 microversion: 2.1 time: 0.097977 Oct 06 12:28:56.409816 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 376/744] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 12:28:56 2022] DELETE /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-volume_attachments/0285b46f-880e-40e1-b475-20d785de50ba => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:28:56.415166 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2562124b-0327-49a8-971a-d92cd7bc8b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:28:56.415829 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2562124b-0327-49a8-971a-d92cd7bc8b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:56.423191 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2562124b-0327-49a8-971a-d92cd7bc8b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:56.423707 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2562124b-0327-49a8-971a-d92cd7bc8b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:56.424138 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2562124b-0327-49a8-971a-d92cd7bc8b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:56.424800 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f325b6b3-74fb-4af1-b274-92ffa413e558 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:56.424948 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2562124b-0327-49a8-971a-d92cd7bc8b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:56.425334 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2562124b-0327-49a8-971a-d92cd7bc8b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:56.425444 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f325b6b3-74fb-4af1-b274-92ffa413e558 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:56.425750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2562124b-0327-49a8-971a-d92cd7bc8b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:56.432414 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f325b6b3-74fb-4af1-b274-92ffa413e558 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:56.432904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f325b6b3-74fb-4af1-b274-92ffa413e558 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:56.433341 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f325b6b3-74fb-4af1-b274-92ffa413e558 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:56.434039 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f325b6b3-74fb-4af1-b274-92ffa413e558 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:56.434498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f325b6b3-74fb-4af1-b274-92ffa413e558 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:56.434924 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f325b6b3-74fb-4af1-b274-92ffa413e558 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:56.500906 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2562124b-0327-49a8-971a-d92cd7bc8b78 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "POST /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/action" status: 202 len: 0 microversion: 2.1 time: 0.089760 Oct 06 12:28:56.501914 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 369/745] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 12:28:56 2022] POST /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:28:56.510740 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c3271457-81d3-4140-9ad3-ca82d5610571 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:56.511731 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c3271457-81d3-4140-9ad3-ca82d5610571 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:56.518664 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c3271457-81d3-4140-9ad3-ca82d5610571 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:56.520124 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c3271457-81d3-4140-9ad3-ca82d5610571 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:56.520639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c3271457-81d3-4140-9ad3-ca82d5610571 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:56.521527 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c3271457-81d3-4140-9ad3-ca82d5610571 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:56.522506 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c3271457-81d3-4140-9ad3-ca82d5610571 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:56.523022 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c3271457-81d3-4140-9ad3-ca82d5610571 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:56.580200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f325b6b3-74fb-4af1-b274-92ffa413e558 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:56.588386 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f325b6b3-74fb-4af1-b274-92ffa413e558 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1678 microversion: 2.1 time: 0.167575 Oct 06 12:28:56.589282 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 377/746] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:56 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:28:56.673178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c3271457-81d3-4140-9ad3-ca82d5610571 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:56.681342 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c3271457-81d3-4140-9ad3-ca82d5610571 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1721 microversion: 2.1 time: 0.174715 Oct 06 12:28:56.681906 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 370/747] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:56 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:57.280141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d19f966b-499e-4f2c-8963-ecd175202655 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:57.280753 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d19f966b-499e-4f2c-8963-ecd175202655 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:57.287095 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d19f966b-499e-4f2c-8963-ecd175202655 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:57.287614 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d19f966b-499e-4f2c-8963-ecd175202655 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:57.288047 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d19f966b-499e-4f2c-8963-ecd175202655 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:57.288751 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d19f966b-499e-4f2c-8963-ecd175202655 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:57.289299 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d19f966b-499e-4f2c-8963-ecd175202655 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:57.289722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d19f966b-499e-4f2c-8963-ecd175202655 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:57.420413 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d19f966b-499e-4f2c-8963-ecd175202655 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:57.430908 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d19f966b-499e-4f2c-8963-ecd175202655 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:57.432681 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d19f966b-499e-4f2c-8963-ecd175202655 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:57.434039 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d19f966b-499e-4f2c-8963-ecd175202655 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.158118 Oct 06 12:28:57.434604 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 378/748] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:57 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:57.611267 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7781cb27-148a-41f4-9daa-321b006183fc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:57.611905 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7781cb27-148a-41f4-9daa-321b006183fc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:57.618209 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7781cb27-148a-41f4-9daa-321b006183fc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:57.618696 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7781cb27-148a-41f4-9daa-321b006183fc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:57.619132 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7781cb27-148a-41f4-9daa-321b006183fc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:57.619851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7781cb27-148a-41f4-9daa-321b006183fc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:57.620308 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7781cb27-148a-41f4-9daa-321b006183fc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:57.620734 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7781cb27-148a-41f4-9daa-321b006183fc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:57.705851 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-333d660c-a9c2-46a9-ac10-7a13e77bb7ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:57.706555 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-333d660c-a9c2-46a9-ac10-7a13e77bb7ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:57.712422 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-333d660c-a9c2-46a9-ac10-7a13e77bb7ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:57.712988 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-333d660c-a9c2-46a9-ac10-7a13e77bb7ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:57.713494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-333d660c-a9c2-46a9-ac10-7a13e77bb7ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:57.714273 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-333d660c-a9c2-46a9-ac10-7a13e77bb7ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:57.714813 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-333d660c-a9c2-46a9-ac10-7a13e77bb7ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:57.715311 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-333d660c-a9c2-46a9-ac10-7a13e77bb7ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:57.769173 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7781cb27-148a-41f4-9daa-321b006183fc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:57.777180 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7781cb27-148a-41f4-9daa-321b006183fc tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1678 microversion: 2.1 time: 0.169706 Oct 06 12:28:57.778335 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 371/749] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:57 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:57.860334 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-333d660c-a9c2-46a9-ac10-7a13e77bb7ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:57.868553 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-333d660c-a9c2-46a9-ac10-7a13e77bb7ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1721 microversion: 2.1 time: 0.166463 Oct 06 12:28:57.869056 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 379/750] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:57 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:28:58.460251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-938175ae-1f17-4cb1-9f6d-965de2ef7e76 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:58.460856 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-938175ae-1f17-4cb1-9f6d-965de2ef7e76 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:58.467205 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-938175ae-1f17-4cb1-9f6d-965de2ef7e76 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:58.467721 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-938175ae-1f17-4cb1-9f6d-965de2ef7e76 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:58.468150 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-938175ae-1f17-4cb1-9f6d-965de2ef7e76 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:58.468826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-938175ae-1f17-4cb1-9f6d-965de2ef7e76 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:58.469268 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-938175ae-1f17-4cb1-9f6d-965de2ef7e76 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:58.469681 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-938175ae-1f17-4cb1-9f6d-965de2ef7e76 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:58.610158 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-938175ae-1f17-4cb1-9f6d-965de2ef7e76 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:58.620429 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-938175ae-1f17-4cb1-9f6d-965de2ef7e76 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:58.622132 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-938175ae-1f17-4cb1-9f6d-965de2ef7e76 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:58.624019 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-938175ae-1f17-4cb1-9f6d-965de2ef7e76 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.167567 Oct 06 12:28:58.624609 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 372/751] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:58 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:58.802099 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-52d31bdf-9a47-4a40-bb62-2f62d5228105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:58.802728 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-52d31bdf-9a47-4a40-bb62-2f62d5228105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:58.809088 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-52d31bdf-9a47-4a40-bb62-2f62d5228105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:58.809570 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-52d31bdf-9a47-4a40-bb62-2f62d5228105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:58.810006 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-52d31bdf-9a47-4a40-bb62-2f62d5228105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:58.811251 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-52d31bdf-9a47-4a40-bb62-2f62d5228105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:58.811739 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-52d31bdf-9a47-4a40-bb62-2f62d5228105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:58.812164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-52d31bdf-9a47-4a40-bb62-2f62d5228105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:58.892557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9df73497-0684-46a9-aa7d-2ff5343a4840 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:58.893165 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9df73497-0684-46a9-aa7d-2ff5343a4840 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:58.899123 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9df73497-0684-46a9-aa7d-2ff5343a4840 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:58.899909 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9df73497-0684-46a9-aa7d-2ff5343a4840 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:58.900362 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9df73497-0684-46a9-aa7d-2ff5343a4840 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:58.901079 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9df73497-0684-46a9-aa7d-2ff5343a4840 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:58.901518 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9df73497-0684-46a9-aa7d-2ff5343a4840 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:58.901942 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9df73497-0684-46a9-aa7d-2ff5343a4840 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:58.939084 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-52d31bdf-9a47-4a40-bb62-2f62d5228105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:58.946895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-52d31bdf-9a47-4a40-bb62-2f62d5228105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1678 microversion: 2.1 time: 0.148612 Oct 06 12:28:58.947719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 380/752] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:58 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:28:59.035139 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9df73497-0684-46a9-aa7d-2ff5343a4840 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:59.044257 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9df73497-0684-46a9-aa7d-2ff5343a4840 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1721 microversion: 2.1 time: 0.155545 Oct 06 12:28:59.045417 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 373/753] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:58 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:28:59.650328 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6a8028b3-e0fb-4c27-b27e-290b6be84284 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:59.650936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-6a8028b3-e0fb-4c27-b27e-290b6be84284 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:59.657591 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6a8028b3-e0fb-4c27-b27e-290b6be84284 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:59.658085 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6a8028b3-e0fb-4c27-b27e-290b6be84284 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:59.658527 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6a8028b3-e0fb-4c27-b27e-290b6be84284 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:59.659221 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6a8028b3-e0fb-4c27-b27e-290b6be84284 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:59.659733 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6a8028b3-e0fb-4c27-b27e-290b6be84284 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:59.660149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6a8028b3-e0fb-4c27-b27e-290b6be84284 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:59.875798 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6a8028b3-e0fb-4c27-b27e-290b6be84284 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:59.884701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6a8028b3-e0fb-4c27-b27e-290b6be84284 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:59.886158 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6a8028b3-e0fb-4c27-b27e-290b6be84284 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:28:59.887358 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-6a8028b3-e0fb-4c27-b27e-290b6be84284 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.241185 Oct 06 12:28:59.887957 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 381/754] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:28:59 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:28:59.971476 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4609c761-6eb8-45e5-9dc8-bdff49a0a41f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:28:59.975345 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4609c761-6eb8-45e5-9dc8-bdff49a0a41f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:28:59.981041 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4609c761-6eb8-45e5-9dc8-bdff49a0a41f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:59.981524 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4609c761-6eb8-45e5-9dc8-bdff49a0a41f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:59.981953 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4609c761-6eb8-45e5-9dc8-bdff49a0a41f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:28:59.982649 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4609c761-6eb8-45e5-9dc8-bdff49a0a41f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:28:59.983101 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4609c761-6eb8-45e5-9dc8-bdff49a0a41f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:28:59.983539 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4609c761-6eb8-45e5-9dc8-bdff49a0a41f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:00.068100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-55e0260e-0399-44e9-8fe3-9722fa080f6f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:00.069049 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-55e0260e-0399-44e9-8fe3-9722fa080f6f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:00.077153 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-55e0260e-0399-44e9-8fe3-9722fa080f6f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:00.077898 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-55e0260e-0399-44e9-8fe3-9722fa080f6f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:00.078529 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-55e0260e-0399-44e9-8fe3-9722fa080f6f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:00.079524 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-55e0260e-0399-44e9-8fe3-9722fa080f6f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:00.080169 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-55e0260e-0399-44e9-8fe3-9722fa080f6f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:00.080781 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-55e0260e-0399-44e9-8fe3-9722fa080f6f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:00.113114 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4609c761-6eb8-45e5-9dc8-bdff49a0a41f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:00.126785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4609c761-6eb8-45e5-9dc8-bdff49a0a41f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1678 microversion: 2.1 time: 0.158648 Oct 06 12:29:00.129082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 374/755] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:28:59 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:00.217710 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-55e0260e-0399-44e9-8fe3-9722fa080f6f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:00.227453 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-55e0260e-0399-44e9-8fe3-9722fa080f6f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1721 microversion: 2.1 time: 0.163168 Oct 06 12:29:00.228363 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 382/756] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:00 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:29:00.915604 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-baf5ea78-cee3-4a6b-9d88-1255fadeb01d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:00.916526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-baf5ea78-cee3-4a6b-9d88-1255fadeb01d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:00.924832 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-baf5ea78-cee3-4a6b-9d88-1255fadeb01d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:00.925597 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-baf5ea78-cee3-4a6b-9d88-1255fadeb01d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:00.926040 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-baf5ea78-cee3-4a6b-9d88-1255fadeb01d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:00.926745 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-baf5ea78-cee3-4a6b-9d88-1255fadeb01d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:00.927268 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-baf5ea78-cee3-4a6b-9d88-1255fadeb01d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:00.927772 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-baf5ea78-cee3-4a6b-9d88-1255fadeb01d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:01.060168 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-baf5ea78-cee3-4a6b-9d88-1255fadeb01d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:01.069114 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-baf5ea78-cee3-4a6b-9d88-1255fadeb01d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:01.070631 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-baf5ea78-cee3-4a6b-9d88-1255fadeb01d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:01.071816 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-baf5ea78-cee3-4a6b-9d88-1255fadeb01d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.162015 Oct 06 12:29:01.072412 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 375/757] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:29:00 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:29:01.156015 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-95269a09-50fd-4b8c-8264-38c431fdd726 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:01.156630 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-95269a09-50fd-4b8c-8264-38c431fdd726 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:01.163116 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95269a09-50fd-4b8c-8264-38c431fdd726 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:01.163729 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95269a09-50fd-4b8c-8264-38c431fdd726 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:01.164165 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95269a09-50fd-4b8c-8264-38c431fdd726 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:01.164848 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95269a09-50fd-4b8c-8264-38c431fdd726 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:01.165299 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95269a09-50fd-4b8c-8264-38c431fdd726 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:01.165717 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95269a09-50fd-4b8c-8264-38c431fdd726 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:01.250887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c4c610c8-343f-4846-a30d-2010fee0a76e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:01.251659 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c4c610c8-343f-4846-a30d-2010fee0a76e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:01.257773 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c4c610c8-343f-4846-a30d-2010fee0a76e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:01.258352 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c4c610c8-343f-4846-a30d-2010fee0a76e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:01.258844 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c4c610c8-343f-4846-a30d-2010fee0a76e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:01.259622 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c4c610c8-343f-4846-a30d-2010fee0a76e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:01.260078 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c4c610c8-343f-4846-a30d-2010fee0a76e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:01.260493 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c4c610c8-343f-4846-a30d-2010fee0a76e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:01.310991 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-95269a09-50fd-4b8c-8264-38c431fdd726 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:01.318931 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-95269a09-50fd-4b8c-8264-38c431fdd726 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1678 microversion: 2.1 time: 0.167349 Oct 06 12:29:01.319616 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 383/758] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:01 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:01.393628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c4c610c8-343f-4846-a30d-2010fee0a76e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:01.401933 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c4c610c8-343f-4846-a30d-2010fee0a76e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1721 microversion: 2.1 time: 0.154915 Oct 06 12:29:01.402498 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 376/759] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:01 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:29:02.098720 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4f636bee-414f-498c-aec8-c3808a22b415 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:02.099376 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-4f636bee-414f-498c-aec8-c3808a22b415 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:02.105229 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4f636bee-414f-498c-aec8-c3808a22b415 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:02.105717 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4f636bee-414f-498c-aec8-c3808a22b415 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:02.106153 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4f636bee-414f-498c-aec8-c3808a22b415 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:02.106845 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4f636bee-414f-498c-aec8-c3808a22b415 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:02.107302 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4f636bee-414f-498c-aec8-c3808a22b415 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:02.107760 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4f636bee-414f-498c-aec8-c3808a22b415 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:02.233169 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4f636bee-414f-498c-aec8-c3808a22b415 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:02.241825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4f636bee-414f-498c-aec8-c3808a22b415 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:02.243273 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4f636bee-414f-498c-aec8-c3808a22b415 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:02.244486 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4f636bee-414f-498c-aec8-c3808a22b415 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.149898 Oct 06 12:29:02.245138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 384/760] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:29:02 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:29:02.342068 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-81040a3a-23bf-4411-bb7c-8210536d8623 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:02.342857 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-81040a3a-23bf-4411-bb7c-8210536d8623 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:02.349000 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81040a3a-23bf-4411-bb7c-8210536d8623 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:02.349419 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81040a3a-23bf-4411-bb7c-8210536d8623 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:02.349845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81040a3a-23bf-4411-bb7c-8210536d8623 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:02.350515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81040a3a-23bf-4411-bb7c-8210536d8623 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:02.350956 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81040a3a-23bf-4411-bb7c-8210536d8623 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:02.351369 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-81040a3a-23bf-4411-bb7c-8210536d8623 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:02.425000 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ad7aea90-1a06-40e2-bcc3-9cedde2084e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:02.425609 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ad7aea90-1a06-40e2-bcc3-9cedde2084e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:02.431357 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ad7aea90-1a06-40e2-bcc3-9cedde2084e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:02.431869 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ad7aea90-1a06-40e2-bcc3-9cedde2084e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:02.432300 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ad7aea90-1a06-40e2-bcc3-9cedde2084e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:02.432988 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ad7aea90-1a06-40e2-bcc3-9cedde2084e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:02.433438 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ad7aea90-1a06-40e2-bcc3-9cedde2084e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:02.433858 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ad7aea90-1a06-40e2-bcc3-9cedde2084e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:02.507390 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-81040a3a-23bf-4411-bb7c-8210536d8623 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:02.515339 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-81040a3a-23bf-4411-bb7c-8210536d8623 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1678 microversion: 2.1 time: 0.177095 Oct 06 12:29:02.515946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 377/761] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:02 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:02.570142 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ad7aea90-1a06-40e2-bcc3-9cedde2084e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:02.578314 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ad7aea90-1a06-40e2-bcc3-9cedde2084e8 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1727 microversion: 2.1 time: 0.157149 Oct 06 12:29:02.578882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 385/762] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:02 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:29:02.600633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e18b88d0-d6bf-4a64-84cb-63190493e23e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:02.601083 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e18b88d0-d6bf-4a64-84cb-63190493e23e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:02.607337 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e18b88d0-d6bf-4a64-84cb-63190493e23e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:02.607860 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e18b88d0-d6bf-4a64-84cb-63190493e23e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:02.608287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e18b88d0-d6bf-4a64-84cb-63190493e23e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:02.608958 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e18b88d0-d6bf-4a64-84cb-63190493e23e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:02.609406 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e18b88d0-d6bf-4a64-84cb-63190493e23e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:02.609841 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e18b88d0-d6bf-4a64-84cb-63190493e23e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:02.688307 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e18b88d0-d6bf-4a64-84cb-63190493e23e tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091583 Oct 06 12:29:02.688906 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 378/763] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 12:29:02 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:29:02.870942 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-6023ea69-c69b-4b58-9b84-1b096094a9b1 req-ba6a35f7-5b84-418c-b830-557fbded3aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b1825b8-e10c-4c5b-adf9-3456c97a68e2", "name": "network-vif-plugged", "status": "completed", "tag": "178adb30-0da6-4996-903a-4ee020de2a0a"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:29:02.882154 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-6023ea69-c69b-4b58-9b84-1b096094a9b1 req-ba6a35f7-5b84-418c-b830-557fbded3aa9 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:02.882722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-6023ea69-c69b-4b58-9b84-1b096094a9b1 req-ba6a35f7-5b84-418c-b830-557fbded3aa9 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:02.883375 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-6023ea69-c69b-4b58-9b84-1b096094a9b1 req-ba6a35f7-5b84-418c-b830-557fbded3aa9 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:02.896430 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-6023ea69-c69b-4b58-9b84-1b096094a9b1 req-ba6a35f7-5b84-418c-b830-557fbded3aa9 service nova] Creating event network-vif-plugged:178adb30-0da6-4996-903a-4ee020de2a0a for instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 on hv-cinder-85604 Oct 06 12:29:02.901800 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-6023ea69-c69b-4b58-9b84-1b096094a9b1 req-ba6a35f7-5b84-418c-b830-557fbded3aa9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035074 Oct 06 12:29:02.902493 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 386/764] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:29:03.270189 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0725edf0-3ccc-42df-952c-508e28b34a6d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:03.270798 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0725edf0-3ccc-42df-952c-508e28b34a6d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:03.276980 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0725edf0-3ccc-42df-952c-508e28b34a6d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:03.277482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0725edf0-3ccc-42df-952c-508e28b34a6d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:03.277901 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0725edf0-3ccc-42df-952c-508e28b34a6d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:03.278671 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0725edf0-3ccc-42df-952c-508e28b34a6d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:03.279815 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0725edf0-3ccc-42df-952c-508e28b34a6d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:03.280259 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0725edf0-3ccc-42df-952c-508e28b34a6d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:03.415876 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0725edf0-3ccc-42df-952c-508e28b34a6d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:03.426803 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0725edf0-3ccc-42df-952c-508e28b34a6d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:03.428446 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0725edf0-3ccc-42df-952c-508e28b34a6d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:03.429738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0725edf0-3ccc-42df-952c-508e28b34a6d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.163463 Oct 06 12:29:03.430581 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 379/765] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:29:03 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:29:03.539412 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2acc32b1-58f7-4198-a3a8-9b4a6f6bb85f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:03.540058 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2acc32b1-58f7-4198-a3a8-9b4a6f6bb85f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:03.546400 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2acc32b1-58f7-4198-a3a8-9b4a6f6bb85f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:03.546932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2acc32b1-58f7-4198-a3a8-9b4a6f6bb85f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:03.547545 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2acc32b1-58f7-4198-a3a8-9b4a6f6bb85f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:03.548247 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2acc32b1-58f7-4198-a3a8-9b4a6f6bb85f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:03.548707 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2acc32b1-58f7-4198-a3a8-9b4a6f6bb85f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:03.549130 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2acc32b1-58f7-4198-a3a8-9b4a6f6bb85f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:03.619260 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-c029976a-73a0-4564-9cae-7493b49bc3d6 req-ce4a5529-8091-4b54-a6e1-089d5b4e95ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1620fb3a-f872-41f2-83d2-909fbe71f438", "tag": "02cb1ceb-4a00-4f6e-8fe3-e8409283f314"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:29:03.636367 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-c029976a-73a0-4564-9cae-7493b49bc3d6 req-ce4a5529-8091-4b54-a6e1-089d5b4e95ca service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:03.640236 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-c029976a-73a0-4564-9cae-7493b49bc3d6 req-ce4a5529-8091-4b54-a6e1-089d5b4e95ca service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:03.640734 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-c029976a-73a0-4564-9cae-7493b49bc3d6 req-ce4a5529-8091-4b54-a6e1-089d5b4e95ca service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:03.672266 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-c029976a-73a0-4564-9cae-7493b49bc3d6 req-ce4a5529-8091-4b54-a6e1-089d5b4e95ca service nova] Creating event network-changed:02cb1ceb-4a00-4f6e-8fe3-e8409283f314 for instance 1620fb3a-f872-41f2-83d2-909fbe71f438 on hv-cinder-85604 Oct 06 12:29:03.677563 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-c029976a-73a0-4564-9cae-7493b49bc3d6 req-ce4a5529-8091-4b54-a6e1-089d5b4e95ca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062715 Oct 06 12:29:03.678603 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 380/766] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:29:03.714040 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2acc32b1-58f7-4198-a3a8-9b4a6f6bb85f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:03.722112 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2acc32b1-58f7-4198-a3a8-9b4a6f6bb85f tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1678 microversion: 2.1 time: 0.187546 Oct 06 12:29:03.722813 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 387/767] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:03 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:04.456482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ab4aef4b-aaf1-4fbe-99e0-67329819e072 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:04.457181 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ab4aef4b-aaf1-4fbe-99e0-67329819e072 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:04.463227 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab4aef4b-aaf1-4fbe-99e0-67329819e072 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:04.463748 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab4aef4b-aaf1-4fbe-99e0-67329819e072 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:04.464187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab4aef4b-aaf1-4fbe-99e0-67329819e072 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:04.464865 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab4aef4b-aaf1-4fbe-99e0-67329819e072 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:04.465317 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab4aef4b-aaf1-4fbe-99e0-67329819e072 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:04.465738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab4aef4b-aaf1-4fbe-99e0-67329819e072 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:04.470118 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:04.748499 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b9909e78-a3c2-4af1-95e7-05ce5eec3d45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:04.749295 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b9909e78-a3c2-4af1-95e7-05ce5eec3d45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:04.756121 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9909e78-a3c2-4af1-95e7-05ce5eec3d45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:04.756763 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9909e78-a3c2-4af1-95e7-05ce5eec3d45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:04.757298 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9909e78-a3c2-4af1-95e7-05ce5eec3d45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:04.758072 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9909e78-a3c2-4af1-95e7-05ce5eec3d45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:04.758606 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9909e78-a3c2-4af1-95e7-05ce5eec3d45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:04.759105 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9909e78-a3c2-4af1-95e7-05ce5eec3d45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:04.818889 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ab4aef4b-aaf1-4fbe-99e0-67329819e072 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:04.828271 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ab4aef4b-aaf1-4fbe-99e0-67329819e072 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:04.829705 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ab4aef4b-aaf1-4fbe-99e0-67329819e072 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:04.830858 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ab4aef4b-aaf1-4fbe-99e0-67329819e072 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.379130 Oct 06 12:29:04.831413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 381/768] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:29:04 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:29:04.900697 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b9909e78-a3c2-4af1-95e7-05ce5eec3d45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:04.908959 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b9909e78-a3c2-4af1-95e7-05ce5eec3d45 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1678 microversion: 2.1 time: 0.164543 Oct 06 12:29:04.909536 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 388/769] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:04 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:29:05.692300 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-3f0e63ff-69e0-4e7e-9b9c-d79b992d98c8 req-13daff6b-b65c-4512-bc4b-b307ab9a6bbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1620fb3a-f872-41f2-83d2-909fbe71f438", "tag": "02cb1ceb-4a00-4f6e-8fe3-e8409283f314"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:29:05.702132 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-3f0e63ff-69e0-4e7e-9b9c-d79b992d98c8 req-13daff6b-b65c-4512-bc4b-b307ab9a6bbb service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:05.702602 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-3f0e63ff-69e0-4e7e-9b9c-d79b992d98c8 req-13daff6b-b65c-4512-bc4b-b307ab9a6bbb service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:05.703027 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-3f0e63ff-69e0-4e7e-9b9c-d79b992d98c8 req-13daff6b-b65c-4512-bc4b-b307ab9a6bbb service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:05.713510 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-3f0e63ff-69e0-4e7e-9b9c-d79b992d98c8 req-13daff6b-b65c-4512-bc4b-b307ab9a6bbb service nova] Creating event network-changed:02cb1ceb-4a00-4f6e-8fe3-e8409283f314 for instance 1620fb3a-f872-41f2-83d2-909fbe71f438 on hv-cinder-85604 Oct 06 12:29:05.718209 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-3f0e63ff-69e0-4e7e-9b9c-d79b992d98c8 req-13daff6b-b65c-4512-bc4b-b307ab9a6bbb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030024 Oct 06 12:29:05.718836 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 382/770] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:29:05.855986 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5ddf247d-72dc-4438-894e-e3c394991fd0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:05.856822 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5ddf247d-72dc-4438-894e-e3c394991fd0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:05.864747 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5ddf247d-72dc-4438-894e-e3c394991fd0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:05.865239 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5ddf247d-72dc-4438-894e-e3c394991fd0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:05.865676 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5ddf247d-72dc-4438-894e-e3c394991fd0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:05.866378 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5ddf247d-72dc-4438-894e-e3c394991fd0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:05.866959 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5ddf247d-72dc-4438-894e-e3c394991fd0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:05.867585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5ddf247d-72dc-4438-894e-e3c394991fd0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:05.935254 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-07571a93-b57b-4d62-bb34-991e835245e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:05.935891 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-07571a93-b57b-4d62-bb34-991e835245e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:05.943776 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-07571a93-b57b-4d62-bb34-991e835245e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:05.944484 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-07571a93-b57b-4d62-bb34-991e835245e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:05.945158 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-07571a93-b57b-4d62-bb34-991e835245e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:05.946104 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-07571a93-b57b-4d62-bb34-991e835245e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:05.946648 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-07571a93-b57b-4d62-bb34-991e835245e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:05.947146 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-07571a93-b57b-4d62-bb34-991e835245e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:06.052130 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5ddf247d-72dc-4438-894e-e3c394991fd0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:06.066292 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5ddf247d-72dc-4438-894e-e3c394991fd0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:06.067967 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5ddf247d-72dc-4438-894e-e3c394991fd0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:06.069198 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5ddf247d-72dc-4438-894e-e3c394991fd0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1806 microversion: 2.20 time: 0.217314 Oct 06 12:29:06.069987 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 389/771] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:29:05 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1806 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:29:06.126735 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-07571a93-b57b-4d62-bb34-991e835245e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:06.135558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-07571a93-b57b-4d62-bb34-991e835245e5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1678 microversion: 2.1 time: 0.206208 Oct 06 12:29:06.135558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 383/772] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:05 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:29:07.095918 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a7c4948d-b2c4-4882-b9be-015b328b0dbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:07.096531 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a7c4948d-b2c4-4882-b9be-015b328b0dbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:07.104300 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a7c4948d-b2c4-4882-b9be-015b328b0dbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:07.104784 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a7c4948d-b2c4-4882-b9be-015b328b0dbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:07.105221 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a7c4948d-b2c4-4882-b9be-015b328b0dbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:07.105911 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a7c4948d-b2c4-4882-b9be-015b328b0dbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:07.106370 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a7c4948d-b2c4-4882-b9be-015b328b0dbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:07.106794 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a7c4948d-b2c4-4882-b9be-015b328b0dbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:07.158847 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-023355e9-13f5-4126-9925-9fe830e18c8b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:07.159604 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-023355e9-13f5-4126-9925-9fe830e18c8b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:07.166816 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-023355e9-13f5-4126-9925-9fe830e18c8b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:07.167383 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-023355e9-13f5-4126-9925-9fe830e18c8b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:07.167920 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-023355e9-13f5-4126-9925-9fe830e18c8b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:07.168707 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-023355e9-13f5-4126-9925-9fe830e18c8b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:07.169168 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-023355e9-13f5-4126-9925-9fe830e18c8b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:07.169596 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-023355e9-13f5-4126-9925-9fe830e18c8b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:07.276507 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a7c4948d-b2c4-4882-b9be-015b328b0dbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:07.285813 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a7c4948d-b2c4-4882-b9be-015b328b0dbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:07.287297 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a7c4948d-b2c4-4882-b9be-015b328b0dbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:07.288525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a7c4948d-b2c4-4882-b9be-015b328b0dbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1793 microversion: 2.20 time: 0.196554 Oct 06 12:29:07.289129 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 390/773] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:29:07 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1793 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:29:07.320864 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-023355e9-13f5-4126-9925-9fe830e18c8b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:07.330327 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-023355e9-13f5-4126-9925-9fe830e18c8b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1678 microversion: 2.1 time: 0.175517 Oct 06 12:29:07.330891 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 384/774] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:07 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:29:08.353371 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-da8760eb-4ccf-48dc-ba00-95355b01b6b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:08.353984 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-da8760eb-4ccf-48dc-ba00-95355b01b6b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:08.360580 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da8760eb-4ccf-48dc-ba00-95355b01b6b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:08.361102 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da8760eb-4ccf-48dc-ba00-95355b01b6b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:08.361540 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da8760eb-4ccf-48dc-ba00-95355b01b6b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:08.362242 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da8760eb-4ccf-48dc-ba00-95355b01b6b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:08.362701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da8760eb-4ccf-48dc-ba00-95355b01b6b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:08.363127 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da8760eb-4ccf-48dc-ba00-95355b01b6b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:08.487887 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-da8760eb-4ccf-48dc-ba00-95355b01b6b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:08.495497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-da8760eb-4ccf-48dc-ba00-95355b01b6b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1678 microversion: 2.1 time: 0.145859 Oct 06 12:29:08.496029 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 391/775] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:08 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:09.518125 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-48aff284-1647-48f4-9655-de88c1861c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:09.518686 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-48aff284-1647-48f4-9655-de88c1861c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:09.525251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48aff284-1647-48f4-9655-de88c1861c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:09.525723 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48aff284-1647-48f4-9655-de88c1861c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:09.526162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48aff284-1647-48f4-9655-de88c1861c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:09.526821 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48aff284-1647-48f4-9655-de88c1861c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:09.527263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48aff284-1647-48f4-9655-de88c1861c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:09.527710 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48aff284-1647-48f4-9655-de88c1861c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:09.658444 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-48aff284-1647-48f4-9655-de88c1861c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:09.666102 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-48aff284-1647-48f4-9655-de88c1861c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1655 microversion: 2.1 time: 0.151859 Oct 06 12:29:09.667007 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 385/776] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:09 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:09.689930 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-341e26c1-c7c2-4314-a2d9-e8dd09d7f306 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:29:09.696246 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-341e26c1-c7c2-4314-a2d9-e8dd09d7f306 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:09.696719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-341e26c1-c7c2-4314-a2d9-e8dd09d7f306 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:09.697150 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-341e26c1-c7c2-4314-a2d9-e8dd09d7f306 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:09.718491 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-341e26c1-c7c2-4314-a2d9-e8dd09d7f306 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Going to try to start instance {{(pid=120508) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 06 12:29:09.758731 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-341e26c1-c7c2-4314-a2d9-e8dd09d7f306 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "POST /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/action" status: 202 len: 0 microversion: 2.1 time: 0.072441 Oct 06 12:29:09.759341 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 392/777] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 12:29:09 2022] POST /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:29:09.767381 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-354383c0-e76d-4c76-8e4e-56638d74d98d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:09.768020 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-354383c0-e76d-4c76-8e4e-56638d74d98d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:09.773901 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-354383c0-e76d-4c76-8e4e-56638d74d98d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:09.774583 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-354383c0-e76d-4c76-8e4e-56638d74d98d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:09.775014 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-354383c0-e76d-4c76-8e4e-56638d74d98d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:09.775768 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-354383c0-e76d-4c76-8e4e-56638d74d98d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:09.776244 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-354383c0-e76d-4c76-8e4e-56638d74d98d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:09.776705 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-354383c0-e76d-4c76-8e4e-56638d74d98d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:09.905462 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-354383c0-e76d-4c76-8e4e-56638d74d98d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:09.913214 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-354383c0-e76d-4c76-8e4e-56638d74d98d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1664 microversion: 2.1 time: 0.149626 Oct 06 12:29:09.913783 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 386/778] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:09 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:10.938212 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-63fc1be4-7224-4459-b0ed-0fa3c5691753 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:10.938912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-63fc1be4-7224-4459-b0ed-0fa3c5691753 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:10.941285 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=66 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:10.946781 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63fc1be4-7224-4459-b0ed-0fa3c5691753 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:10.947275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63fc1be4-7224-4459-b0ed-0fa3c5691753 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:10.947744 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63fc1be4-7224-4459-b0ed-0fa3c5691753 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:10.948443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63fc1be4-7224-4459-b0ed-0fa3c5691753 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:10.948901 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63fc1be4-7224-4459-b0ed-0fa3c5691753 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:10.949323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63fc1be4-7224-4459-b0ed-0fa3c5691753 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:10.953282 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:11.081928 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-63fc1be4-7224-4459-b0ed-0fa3c5691753 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:11.089434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-63fc1be4-7224-4459-b0ed-0fa3c5691753 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1664 microversion: 2.1 time: 0.156067 Oct 06 12:29:11.090005 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 393/779] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:10 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:12.113043 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-45609636-9343-45c0-8e6d-fd1cc35ab85b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:12.114837 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-45609636-9343-45c0-8e6d-fd1cc35ab85b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:12.116099 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=68 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:12.121381 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-45609636-9343-45c0-8e6d-fd1cc35ab85b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:12.122357 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-45609636-9343-45c0-8e6d-fd1cc35ab85b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:12.122792 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-45609636-9343-45c0-8e6d-fd1cc35ab85b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:12.123478 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-45609636-9343-45c0-8e6d-fd1cc35ab85b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:12.123951 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-45609636-9343-45c0-8e6d-fd1cc35ab85b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:12.124375 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-45609636-9343-45c0-8e6d-fd1cc35ab85b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:12.250460 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-45609636-9343-45c0-8e6d-fd1cc35ab85b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:12.258881 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-45609636-9343-45c0-8e6d-fd1cc35ab85b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1668 microversion: 2.1 time: 0.149709 Oct 06 12:29:12.259443 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 387/780] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:12 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:17.640143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-240329b2-094c-4cf0-82cb-2ab9e5bd5a53 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:29:17.642440 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-240329b2-094c-4cf0-82cb-2ab9e5bd5a53 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:17.648625 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-240329b2-094c-4cf0-82cb-2ab9e5bd5a53 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:17.649358 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-240329b2-094c-4cf0-82cb-2ab9e5bd5a53 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:17.649785 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-240329b2-094c-4cf0-82cb-2ab9e5bd5a53 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:17.650463 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-240329b2-094c-4cf0-82cb-2ab9e5bd5a53 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:17.650914 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-240329b2-094c-4cf0-82cb-2ab9e5bd5a53 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:17.651357 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-240329b2-094c-4cf0-82cb-2ab9e5bd5a53 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:17.724209 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-240329b2-094c-4cf0-82cb-2ab9e5bd5a53 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "POST /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/action" status: 202 len: 0 microversion: 2.1 time: 0.088383 Oct 06 12:29:17.725391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 394/781] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 12:29:17 2022] POST /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:29:17.733959 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e694a99c-4856-4dd1-89e1-714e63c3fb38 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:17.734583 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e694a99c-4856-4dd1-89e1-714e63c3fb38 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:17.741215 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e694a99c-4856-4dd1-89e1-714e63c3fb38 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:17.741702 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e694a99c-4856-4dd1-89e1-714e63c3fb38 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:17.742162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e694a99c-4856-4dd1-89e1-714e63c3fb38 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:17.742820 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e694a99c-4856-4dd1-89e1-714e63c3fb38 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:17.743264 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e694a99c-4856-4dd1-89e1-714e63c3fb38 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:17.743740 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e694a99c-4856-4dd1-89e1-714e63c3fb38 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:17.888284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e694a99c-4856-4dd1-89e1-714e63c3fb38 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:17.896683 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e694a99c-4856-4dd1-89e1-714e63c3fb38 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1753 microversion: 2.1 time: 0.166990 Oct 06 12:29:17.897194 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 388/782] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:17 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:18.921525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f7b29e54-6b82-4425-a202-a2d2d0323b2e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:18.922234 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f7b29e54-6b82-4425-a202-a2d2d0323b2e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:18.929197 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7b29e54-6b82-4425-a202-a2d2d0323b2e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:18.929625 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7b29e54-6b82-4425-a202-a2d2d0323b2e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:18.930065 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7b29e54-6b82-4425-a202-a2d2d0323b2e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:18.930756 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7b29e54-6b82-4425-a202-a2d2d0323b2e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:18.931217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7b29e54-6b82-4425-a202-a2d2d0323b2e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:18.931678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7b29e54-6b82-4425-a202-a2d2d0323b2e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:19.076693 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f7b29e54-6b82-4425-a202-a2d2d0323b2e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:19.084874 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f7b29e54-6b82-4425-a202-a2d2d0323b2e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1758 microversion: 2.1 time: 0.168203 Oct 06 12:29:19.085443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 395/783] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:18 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:20.107944 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f214374d-d6d4-4e2b-9436-54ff175baec5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:20.108540 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f214374d-d6d4-4e2b-9436-54ff175baec5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:20.115129 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f214374d-d6d4-4e2b-9436-54ff175baec5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:20.115648 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f214374d-d6d4-4e2b-9436-54ff175baec5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:20.116081 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f214374d-d6d4-4e2b-9436-54ff175baec5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:20.116758 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f214374d-d6d4-4e2b-9436-54ff175baec5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:20.117213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f214374d-d6d4-4e2b-9436-54ff175baec5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:20.117635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f214374d-d6d4-4e2b-9436-54ff175baec5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:20.257631 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f214374d-d6d4-4e2b-9436-54ff175baec5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:20.265786 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f214374d-d6d4-4e2b-9436-54ff175baec5 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1758 microversion: 2.1 time: 0.161747 Oct 06 12:29:20.266348 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 389/784] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:20 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:21.289539 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-cbcb1c04-0dd2-4f22-9b5d-590bc4f2bfd0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:21.290151 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-cbcb1c04-0dd2-4f22-9b5d-590bc4f2bfd0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:21.296598 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cbcb1c04-0dd2-4f22-9b5d-590bc4f2bfd0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:21.297084 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cbcb1c04-0dd2-4f22-9b5d-590bc4f2bfd0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:21.297516 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cbcb1c04-0dd2-4f22-9b5d-590bc4f2bfd0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:21.298205 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cbcb1c04-0dd2-4f22-9b5d-590bc4f2bfd0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:21.298661 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cbcb1c04-0dd2-4f22-9b5d-590bc4f2bfd0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:21.299085 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cbcb1c04-0dd2-4f22-9b5d-590bc4f2bfd0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:21.444195 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-cbcb1c04-0dd2-4f22-9b5d-590bc4f2bfd0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:21.452784 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-cbcb1c04-0dd2-4f22-9b5d-590bc4f2bfd0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1758 microversion: 2.1 time: 0.167166 Oct 06 12:29:21.453355 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 396/785] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:21 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:22.476856 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3d531e47-afbf-4794-8aea-d9bca81c35e1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:22.477460 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3d531e47-afbf-4794-8aea-d9bca81c35e1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:22.483372 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d531e47-afbf-4794-8aea-d9bca81c35e1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:22.483882 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d531e47-afbf-4794-8aea-d9bca81c35e1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:22.484315 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d531e47-afbf-4794-8aea-d9bca81c35e1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:22.484994 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d531e47-afbf-4794-8aea-d9bca81c35e1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:22.485447 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d531e47-afbf-4794-8aea-d9bca81c35e1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:22.485869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d531e47-afbf-4794-8aea-d9bca81c35e1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:22.622438 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3d531e47-afbf-4794-8aea-d9bca81c35e1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:22.630566 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3d531e47-afbf-4794-8aea-d9bca81c35e1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1758 microversion: 2.1 time: 0.157690 Oct 06 12:29:22.631130 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 390/786] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:22 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1758 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:23.654497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6f06a77e-6b16-4a80-ab1f-86bec4cd294e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:23.655107 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-6f06a77e-6b16-4a80-ab1f-86bec4cd294e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:23.661396 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f06a77e-6b16-4a80-ab1f-86bec4cd294e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:23.661872 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f06a77e-6b16-4a80-ab1f-86bec4cd294e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:23.662302 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f06a77e-6b16-4a80-ab1f-86bec4cd294e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:23.662983 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f06a77e-6b16-4a80-ab1f-86bec4cd294e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:23.663434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f06a77e-6b16-4a80-ab1f-86bec4cd294e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:23.663875 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f06a77e-6b16-4a80-ab1f-86bec4cd294e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:23.810523 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6f06a77e-6b16-4a80-ab1f-86bec4cd294e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:23.818776 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-6f06a77e-6b16-4a80-ab1f-86bec4cd294e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1758 microversion: 2.1 time: 0.168123 Oct 06 12:29:23.819270 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 397/787] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:23 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:24.842799 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-bf30e170-eb43-4e01-a3e2-9693351dbc01 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:24.843402 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-bf30e170-eb43-4e01-a3e2-9693351dbc01 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:24.849772 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bf30e170-eb43-4e01-a3e2-9693351dbc01 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:24.850249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bf30e170-eb43-4e01-a3e2-9693351dbc01 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:24.850678 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bf30e170-eb43-4e01-a3e2-9693351dbc01 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:24.851354 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bf30e170-eb43-4e01-a3e2-9693351dbc01 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:24.851847 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bf30e170-eb43-4e01-a3e2-9693351dbc01 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:24.852272 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bf30e170-eb43-4e01-a3e2-9693351dbc01 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:24.991296 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-bf30e170-eb43-4e01-a3e2-9693351dbc01 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:24.999367 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-bf30e170-eb43-4e01-a3e2-9693351dbc01 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1758 microversion: 2.1 time: 0.161045 Oct 06 12:29:24.999960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 391/788] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:24 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:26.023172 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b12ed42c-f0ec-4b82-8a7a-9a411995db55 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:26.024068 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b12ed42c-f0ec-4b82-8a7a-9a411995db55 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:26.030865 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b12ed42c-f0ec-4b82-8a7a-9a411995db55 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:26.031351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b12ed42c-f0ec-4b82-8a7a-9a411995db55 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:26.031825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b12ed42c-f0ec-4b82-8a7a-9a411995db55 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:26.032519 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b12ed42c-f0ec-4b82-8a7a-9a411995db55 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:26.032974 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b12ed42c-f0ec-4b82-8a7a-9a411995db55 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:26.033397 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b12ed42c-f0ec-4b82-8a7a-9a411995db55 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:26.171835 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b12ed42c-f0ec-4b82-8a7a-9a411995db55 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:26.179894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b12ed42c-f0ec-4b82-8a7a-9a411995db55 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1758 microversion: 2.1 time: 0.160627 Oct 06 12:29:26.180466 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 398/789] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:26 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:27.203707 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5659f128-48d8-4649-88ae-f2a52c7728bb tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:27.204349 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5659f128-48d8-4649-88ae-f2a52c7728bb tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:27.210591 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5659f128-48d8-4649-88ae-f2a52c7728bb tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:27.211069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5659f128-48d8-4649-88ae-f2a52c7728bb tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:27.211498 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5659f128-48d8-4649-88ae-f2a52c7728bb tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:27.212197 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5659f128-48d8-4649-88ae-f2a52c7728bb tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:27.212648 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5659f128-48d8-4649-88ae-f2a52c7728bb tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:27.213120 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5659f128-48d8-4649-88ae-f2a52c7728bb tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:27.353998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5659f128-48d8-4649-88ae-f2a52c7728bb tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:27.362669 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5659f128-48d8-4649-88ae-f2a52c7728bb tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1758 microversion: 2.1 time: 0.162891 Oct 06 12:29:27.363237 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 392/790] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:27 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:28.386003 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-eac0cc23-90d0-46be-bb73-31e4df4f9463 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:28.387197 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-eac0cc23-90d0-46be-bb73-31e4df4f9463 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:28.393625 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eac0cc23-90d0-46be-bb73-31e4df4f9463 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:28.394106 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eac0cc23-90d0-46be-bb73-31e4df4f9463 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:28.394539 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eac0cc23-90d0-46be-bb73-31e4df4f9463 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:28.395225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eac0cc23-90d0-46be-bb73-31e4df4f9463 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:28.395705 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eac0cc23-90d0-46be-bb73-31e4df4f9463 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:28.396133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eac0cc23-90d0-46be-bb73-31e4df4f9463 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:28.542278 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-eac0cc23-90d0-46be-bb73-31e4df4f9463 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:28.550966 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-eac0cc23-90d0-46be-bb73-31e4df4f9463 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1758 microversion: 2.1 time: 0.168840 Oct 06 12:29:28.551563 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 399/791] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:28 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:29.574057 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0495e283-4dbf-4ed5-b939-757cfa14294f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:29.574689 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0495e283-4dbf-4ed5-b939-757cfa14294f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:29.581159 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0495e283-4dbf-4ed5-b939-757cfa14294f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:29.581629 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0495e283-4dbf-4ed5-b939-757cfa14294f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:29.582049 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0495e283-4dbf-4ed5-b939-757cfa14294f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:29.582717 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0495e283-4dbf-4ed5-b939-757cfa14294f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:29.583159 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0495e283-4dbf-4ed5-b939-757cfa14294f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:29.583606 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0495e283-4dbf-4ed5-b939-757cfa14294f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:29.727974 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0495e283-4dbf-4ed5-b939-757cfa14294f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:29.736575 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0495e283-4dbf-4ed5-b939-757cfa14294f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1758 microversion: 2.1 time: 0.166496 Oct 06 12:29:29.737138 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 393/792] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:29 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:30.760106 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9a6ff626-db2d-4c9f-9e1c-e1c678757d75 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:30.760757 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9a6ff626-db2d-4c9f-9e1c-e1c678757d75 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:30.767772 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9a6ff626-db2d-4c9f-9e1c-e1c678757d75 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:30.768256 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9a6ff626-db2d-4c9f-9e1c-e1c678757d75 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:30.768692 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9a6ff626-db2d-4c9f-9e1c-e1c678757d75 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:30.769382 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9a6ff626-db2d-4c9f-9e1c-e1c678757d75 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:30.769841 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9a6ff626-db2d-4c9f-9e1c-e1c678757d75 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:30.770270 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9a6ff626-db2d-4c9f-9e1c-e1c678757d75 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:30.910995 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9a6ff626-db2d-4c9f-9e1c-e1c678757d75 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:30.919664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9a6ff626-db2d-4c9f-9e1c-e1c678757d75 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1758 microversion: 2.1 time: 0.163438 Oct 06 12:29:30.920231 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 400/793] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:30 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:31.943081 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9bb5b6bb-8b39-45a5-929d-50830891a9b9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:31.943714 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9bb5b6bb-8b39-45a5-929d-50830891a9b9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:31.950101 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9bb5b6bb-8b39-45a5-929d-50830891a9b9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:31.950579 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9bb5b6bb-8b39-45a5-929d-50830891a9b9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:31.951011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9bb5b6bb-8b39-45a5-929d-50830891a9b9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:31.951723 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9bb5b6bb-8b39-45a5-929d-50830891a9b9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:31.952175 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9bb5b6bb-8b39-45a5-929d-50830891a9b9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:31.952598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9bb5b6bb-8b39-45a5-929d-50830891a9b9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:32.090007 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9bb5b6bb-8b39-45a5-929d-50830891a9b9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:32.098066 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9bb5b6bb-8b39-45a5-929d-50830891a9b9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1758 microversion: 2.1 time: 0.158838 Oct 06 12:29:32.098633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 394/794] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:31 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1758 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:33.121700 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-903192f1-0279-4a7c-8f22-4a07c213dcdf tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:33.122306 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-903192f1-0279-4a7c-8f22-4a07c213dcdf tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:33.128741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-903192f1-0279-4a7c-8f22-4a07c213dcdf tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:33.129223 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-903192f1-0279-4a7c-8f22-4a07c213dcdf tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:33.129653 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-903192f1-0279-4a7c-8f22-4a07c213dcdf tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:33.130329 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-903192f1-0279-4a7c-8f22-4a07c213dcdf tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:33.130777 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-903192f1-0279-4a7c-8f22-4a07c213dcdf tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:33.131195 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-903192f1-0279-4a7c-8f22-4a07c213dcdf tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:33.274065 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-903192f1-0279-4a7c-8f22-4a07c213dcdf tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:33.282714 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-903192f1-0279-4a7c-8f22-4a07c213dcdf tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1758 microversion: 2.1 time: 0.164905 Oct 06 12:29:33.283279 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 401/795] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:33 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:34.305668 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f980fcb5-03d5-49cc-842c-f22c42adb9dd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:34.306277 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f980fcb5-03d5-49cc-842c-f22c42adb9dd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:34.313205 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f980fcb5-03d5-49cc-842c-f22c42adb9dd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:34.313688 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f980fcb5-03d5-49cc-842c-f22c42adb9dd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:34.314121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f980fcb5-03d5-49cc-842c-f22c42adb9dd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:34.314805 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f980fcb5-03d5-49cc-842c-f22c42adb9dd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:34.315259 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f980fcb5-03d5-49cc-842c-f22c42adb9dd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:34.315716 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f980fcb5-03d5-49cc-842c-f22c42adb9dd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:34.454769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f980fcb5-03d5-49cc-842c-f22c42adb9dd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:34.462925 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f980fcb5-03d5-49cc-842c-f22c42adb9dd tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1758 microversion: 2.1 time: 0.161099 Oct 06 12:29:34.463498 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 395/796] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:34 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:29:35.489195 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d11ab3d1-ffaf-46a4-8312-8c3136ddb089 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:29:35.489810 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d11ab3d1-ffaf-46a4-8312-8c3136ddb089 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:29:35.496924 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d11ab3d1-ffaf-46a4-8312-8c3136ddb089 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:35.497352 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d11ab3d1-ffaf-46a4-8312-8c3136ddb089 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:35.497788 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d11ab3d1-ffaf-46a4-8312-8c3136ddb089 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:35.498481 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d11ab3d1-ffaf-46a4-8312-8c3136ddb089 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:29:35.498943 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d11ab3d1-ffaf-46a4-8312-8c3136ddb089 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:29:35.499370 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d11ab3d1-ffaf-46a4-8312-8c3136ddb089 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:29:35.642521 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d11ab3d1-ffaf-46a4-8312-8c3136ddb089 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:29:35.650952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d11ab3d1-ffaf-46a4-8312-8c3136ddb089 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1761 microversion: 2.1 time: 0.165714 Oct 06 12:29:35.651558 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 402/797] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:29:35 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1761 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:03.451657 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8708a5ba-8e1b-4d2d-984d-795d30e62562 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:03.452247 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8708a5ba-8e1b-4d2d-984d-795d30e62562 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:03.454294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=17 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:03.455138 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=84 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:03.461155 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8708a5ba-8e1b-4d2d-984d-795d30e62562 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:03.461639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8708a5ba-8e1b-4d2d-984d-795d30e62562 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:03.462074 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8708a5ba-8e1b-4d2d-984d-795d30e62562 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:03.462801 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8708a5ba-8e1b-4d2d-984d-795d30e62562 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:03.463261 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8708a5ba-8e1b-4d2d-984d-795d30e62562 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:03.463716 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8708a5ba-8e1b-4d2d-984d-795d30e62562 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:03.488586 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8708a5ba-8e1b-4d2d-984d-795d30e62562 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Going to try to terminate instance {{(pid=120509) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:30:03.565092 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8708a5ba-8e1b-4d2d-984d-795d30e62562 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 204 len: 0 microversion: 2.1 time: 0.116928 Oct 06 12:30:03.565680 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 396/798] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:30:03 2022] DELETE /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:30:03.574283 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c80d2062-062e-4402-95c6-0dd586719441 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:03.574898 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c80d2062-062e-4402-95c6-0dd586719441 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:03.577240 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=19 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:03.578051 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:03.584122 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c80d2062-062e-4402-95c6-0dd586719441 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:03.584618 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c80d2062-062e-4402-95c6-0dd586719441 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:03.585054 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c80d2062-062e-4402-95c6-0dd586719441 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:03.585745 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c80d2062-062e-4402-95c6-0dd586719441 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:03.586202 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c80d2062-062e-4402-95c6-0dd586719441 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:03.586627 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c80d2062-062e-4402-95c6-0dd586719441 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:03.714590 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c80d2062-062e-4402-95c6-0dd586719441 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:03.722204 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c80d2062-062e-4402-95c6-0dd586719441 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1577 microversion: 2.1 time: 0.152090 Oct 06 12:30:03.722775 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 403/799] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:03 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:30:04.745841 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0f690728-d189-4bc9-800a-7fb480f2b313 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:04.746526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0f690728-d189-4bc9-800a-7fb480f2b313 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:04.752873 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0f690728-d189-4bc9-800a-7fb480f2b313 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:04.753347 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0f690728-d189-4bc9-800a-7fb480f2b313 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:04.753775 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0f690728-d189-4bc9-800a-7fb480f2b313 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:04.754448 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0f690728-d189-4bc9-800a-7fb480f2b313 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:04.754894 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0f690728-d189-4bc9-800a-7fb480f2b313 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:04.755310 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0f690728-d189-4bc9-800a-7fb480f2b313 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:04.886150 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0f690728-d189-4bc9-800a-7fb480f2b313 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:04.893752 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0f690728-d189-4bc9-800a-7fb480f2b313 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1577 microversion: 2.1 time: 0.152148 Oct 06 12:30:04.894318 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 397/800] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:04 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:05.916767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-27e913cd-b90d-49f6-b138-923690b1e39e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:05.917254 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-27e913cd-b90d-49f6-b138-923690b1e39e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:05.923344 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-27e913cd-b90d-49f6-b138-923690b1e39e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:05.923880 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-27e913cd-b90d-49f6-b138-923690b1e39e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:05.924309 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-27e913cd-b90d-49f6-b138-923690b1e39e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:05.924990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-27e913cd-b90d-49f6-b138-923690b1e39e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:05.925438 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-27e913cd-b90d-49f6-b138-923690b1e39e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:05.925856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-27e913cd-b90d-49f6-b138-923690b1e39e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:06.062784 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-27e913cd-b90d-49f6-b138-923690b1e39e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:06.070410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-27e913cd-b90d-49f6-b138-923690b1e39e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1577 microversion: 2.1 time: 0.157682 Oct 06 12:30:06.070985 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 404/801] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:05 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:30:06.565828 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-f8a2c595-6a4b-4259-9eb0-427aa4446df2 req-cc59717b-4f66-44aa-abd4-659b0805a7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a965adee-462e-4616-9ffe-bcb94e58c7ae", "name": "network-vif-deleted", "tag": "99d2670f-f58f-45d7-a104-307b021263f0"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:06.577621 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-f8a2c595-6a4b-4259-9eb0-427aa4446df2 req-cc59717b-4f66-44aa-abd4-659b0805a7c2 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:06.578105 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-f8a2c595-6a4b-4259-9eb0-427aa4446df2 req-cc59717b-4f66-44aa-abd4-659b0805a7c2 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:06.578539 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-f8a2c595-6a4b-4259-9eb0-427aa4446df2 req-cc59717b-4f66-44aa-abd4-659b0805a7c2 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:06.592081 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-f8a2c595-6a4b-4259-9eb0-427aa4446df2 req-cc59717b-4f66-44aa-abd4-659b0805a7c2 service nova] Creating event network-vif-deleted:99d2670f-f58f-45d7-a104-307b021263f0 for instance a965adee-462e-4616-9ffe-bcb94e58c7ae on hv-cinder-85604 Oct 06 12:30:06.598422 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-f8a2c595-6a4b-4259-9eb0-427aa4446df2 req-cc59717b-4f66-44aa-abd4-659b0805a7c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035857 Oct 06 12:30:06.602792 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 398/802] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:07.097090 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5c9d5b37-1193-4ae4-bcee-b75056431249 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:07.098572 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5c9d5b37-1193-4ae4-bcee-b75056431249 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:07.108455 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c9d5b37-1193-4ae4-bcee-b75056431249 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:07.109039 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c9d5b37-1193-4ae4-bcee-b75056431249 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:07.109440 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c9d5b37-1193-4ae4-bcee-b75056431249 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:07.110164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c9d5b37-1193-4ae4-bcee-b75056431249 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:07.110623 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c9d5b37-1193-4ae4-bcee-b75056431249 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:07.111120 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c9d5b37-1193-4ae4-bcee-b75056431249 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:07.152058 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c9d5b37-1193-4ae4-bcee-b75056431249 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:07.152554 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c9d5b37-1193-4ae4-bcee-b75056431249 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:07.152991 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5c9d5b37-1193-4ae4-bcee-b75056431249 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:07.153447 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-5c9d5b37-1193-4ae4-bcee-b75056431249 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lazy-loading 'fault' on Instance uuid a965adee-462e-4616-9ffe-bcb94e58c7ae {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:30:07.200464 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5c9d5b37-1193-4ae4-bcee-b75056431249 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:07.209730 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5c9d5b37-1193-4ae4-bcee-b75056431249 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 200 len: 1229 microversion: 2.1 time: 0.117706 Oct 06 12:30:07.210646 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 405/803] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:07 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 1229 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:08.235388 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-53488d18-d73c-4b96-be64-206c42596f64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:08.236536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-53488d18-d73c-4b96-be64-206c42596f64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:08.244056 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-53488d18-d73c-4b96-be64-206c42596f64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:08.244542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-53488d18-d73c-4b96-be64-206c42596f64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:08.244981 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-53488d18-d73c-4b96-be64-206c42596f64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:08.245695 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-53488d18-d73c-4b96-be64-206c42596f64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:08.246537 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-53488d18-d73c-4b96-be64-206c42596f64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:08.246710 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-53488d18-d73c-4b96-be64-206c42596f64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:08.264588 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-53488d18-d73c-4b96-be64-206c42596f64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] HTTP exception thrown: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-53488d18-d73c-4b96-be64-206c42596f64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Request method failure captured: Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae HTTP/1.1 Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPskuUx-wlgzCT7jVFY503HfgQZALsqMNcThj2AfG-b4jN2uZrnSDMB5RSgbFAUp_HzkY7gHKqtaUnqa5tZZ1ZQpDsbGSqYb1r2ZhZEZesbhgTxU5q2cWAmN80R4s-VeljjIEKovSZW9w-Plwe1BypUYEi5WPWLytPj8bKma4RUaIMwY Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: c80feb95ecbf413ca0bc52a519bf43b7 Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-TestVolumeBootPattern-152508398 Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:30:08.266336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:30:08.267818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c80feb95ecbf413ca0bc52a519bf43b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c80feb95ecbf413ca0bc52a519bf43b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c80feb95ecbf413ca0bc52a519bf43b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c80feb95ecbf413ca0bc52a519bf43b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:30:08.267818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-TestVolumeBootPattern-152508398 Oct 06 12:30:08.267818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: c80feb95ecbf413ca0bc52a519bf43b7 Oct 06 12:30:08.267818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-TestVolumeBootPattern-152508398 Oct 06 12:30:08.267818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-TestVolumeBootPattern-152508398-project Oct 06 12:30:08.267818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:30:08.267818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:30:08.267818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: dff0daad12c143fabd16d40a1939b87e Oct 06 12:30:08.267818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-TestVolumeBootPattern-152508398-project Oct 06 12:30:08.267818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:30:08.267818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. Oct 06 12:30:08.267818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': 'a965adee-462e-4616-9ffe-bcb94e58c7ae'} Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:30:08.268817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. Oct 06 12:30:08.270769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:08.273129 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-53488d18-d73c-4b96-be64-206c42596f64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Returning 404 to user: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:30:08.273129 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-53488d18-d73c-4b96-be64-206c42596f64 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 404 len: 111 microversion: 2.1 time: 0.037247 Oct 06 12:30:08.273129 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 399/804] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:08 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:30:08.404712 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1656157396", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-679794386", "security_groups": [{"name": "tempest-secgroup-smoke-1201469717"}], "block_device_mapping_v2": [{"uuid": "60c2b685-4af7-43ac-9fd8-cd79c847beab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "397bf80c-f529-4030-8ca3-f73bf801b9a0"}]}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:08.528213 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.network.neutron [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] validate_networks() for [('397bf80c-f529-4030-8ca3-f73bf801b9a0', None, None, None, None, None)] {{(pid=120508) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:30:08.925474 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Flavor limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:30:08.925893 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Image limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:30:08.926399 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Flavor pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:30:08.926795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Image pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:30:08.927200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:30:08.935666 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:08.936146 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:08.936607 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:08.937320 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:08.938065 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:08.938501 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:08.955811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Getting quotas for project c80feb95ecbf413ca0bc52a519bf43b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:30:08.960734 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Getting quotas for user dff0daad12c143fabd16d40a1939b87e and project c80feb95ecbf413ca0bc52a519bf43b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:30:09.034298 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Going to run 1 instances... {{(pid=120508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:30:09.036789 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60c2b685-4af7-43ac-9fd8-cd79c847beab',volume_size=None,volume_type=None)] {{(pid=120508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:30:09.174857 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-0f517deb-23fa-440a-8669-7cc0d873a089 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.773877 Oct 06 12:30:09.175445 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 406/805] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:30:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:30:09.187135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f5b54b29-1b65-44ad-98c1-ee16a4178bd9 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:09.187772 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f5b54b29-1b65-44ad-98c1-ee16a4178bd9 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:09.248065 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f5b54b29-1b65-44ad-98c1-ee16a4178bd9 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:09.255531 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f5b54b29-1b65-44ad-98c1-ee16a4178bd9 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1094 microversion: 2.1 time: 0.072821 Oct 06 12:30:09.256109 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 400/806] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:09 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:10.112578 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-11f20970-719f-4c4c-8b6e-7655b3402ea5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:10.113139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-11f20970-719f-4c4c-8b6e-7655b3402ea5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:10.120137 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-11f20970-719f-4c4c-8b6e-7655b3402ea5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:10.120641 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-11f20970-719f-4c4c-8b6e-7655b3402ea5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:10.121064 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-11f20970-719f-4c4c-8b6e-7655b3402ea5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:10.121760 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-11f20970-719f-4c4c-8b6e-7655b3402ea5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:10.122215 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-11f20970-719f-4c4c-8b6e-7655b3402ea5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:10.122644 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-11f20970-719f-4c4c-8b6e-7655b3402ea5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:10.207423 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-11f20970-719f-4c4c-8b6e-7655b3402ea5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lazy-loading 'services' on Instance uuid 1620fb3a-f872-41f2-83d2-909fbe71f438 {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:30:10.278899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9272a28b-6eeb-4ace-967c-9c50a979cfc2 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:10.279619 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9272a28b-6eeb-4ace-967c-9c50a979cfc2 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:10.282864 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-11f20970-719f-4c4c-8b6e-7655b3402ea5 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-volume_attachments/0285b46f-880e-40e1-b475-20d785de50ba" status: 202 len: 0 microversion: 2.1 time: 0.173582 Oct 06 12:30:10.283621 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 407/807] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 12:30:10 2022] DELETE /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-volume_attachments/0285b46f-880e-40e1-b475-20d785de50ba => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:30:10.287270 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9272a28b-6eeb-4ace-967c-9c50a979cfc2 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:10.287782 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9272a28b-6eeb-4ace-967c-9c50a979cfc2 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:10.288227 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9272a28b-6eeb-4ace-967c-9c50a979cfc2 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:10.288934 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9272a28b-6eeb-4ace-967c-9c50a979cfc2 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:10.289383 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9272a28b-6eeb-4ace-967c-9c50a979cfc2 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:10.289802 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9272a28b-6eeb-4ace-967c-9c50a979cfc2 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:10.295252 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-225b48ff-2968-4a80-bd35-5643080f9622 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:10.298512 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-225b48ff-2968-4a80-bd35-5643080f9622 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:10.308592 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-225b48ff-2968-4a80-bd35-5643080f9622 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:10.309303 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-225b48ff-2968-4a80-bd35-5643080f9622 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:10.309979 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-225b48ff-2968-4a80-bd35-5643080f9622 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:10.310871 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-225b48ff-2968-4a80-bd35-5643080f9622 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:10.311338 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-225b48ff-2968-4a80-bd35-5643080f9622 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:10.311848 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-225b48ff-2968-4a80-bd35-5643080f9622 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:10.345300 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-225b48ff-2968-4a80-bd35-5643080f9622 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055044 Oct 06 12:30:10.345883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 408/808] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:30:10 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:10.366962 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9272a28b-6eeb-4ace-967c-9c50a979cfc2 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:10.376160 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9272a28b-6eeb-4ace-967c-9c50a979cfc2 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1192 microversion: 2.1 time: 0.101073 Oct 06 12:30:10.377029 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 401/809] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:10 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1192 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:11.358528 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b9644932-22e5-4fe5-9007-eed968f99040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:11.360720 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b9644932-22e5-4fe5-9007-eed968f99040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:11.367176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9644932-22e5-4fe5-9007-eed968f99040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:11.367705 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9644932-22e5-4fe5-9007-eed968f99040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:11.368142 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9644932-22e5-4fe5-9007-eed968f99040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:11.368878 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9644932-22e5-4fe5-9007-eed968f99040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:11.369336 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9644932-22e5-4fe5-9007-eed968f99040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:11.369761 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b9644932-22e5-4fe5-9007-eed968f99040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:11.400042 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-53423bd9-af40-4b7b-b532-251971c3ec5e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:11.400666 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-53423bd9-af40-4b7b-b532-251971c3ec5e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:11.403339 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b9644932-22e5-4fe5-9007-eed968f99040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048818 Oct 06 12:30:11.404402 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 409/810] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:30:11 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:11.411729 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-53423bd9-af40-4b7b-b532-251971c3ec5e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:11.412214 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-53423bd9-af40-4b7b-b532-251971c3ec5e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:11.412635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-53423bd9-af40-4b7b-b532-251971c3ec5e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:11.413331 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-53423bd9-af40-4b7b-b532-251971c3ec5e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:11.413782 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-53423bd9-af40-4b7b-b532-251971c3ec5e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:11.414203 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-53423bd9-af40-4b7b-b532-251971c3ec5e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:11.478324 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-53423bd9-af40-4b7b-b532-251971c3ec5e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:11.486120 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-53423bd9-af40-4b7b-b532-251971c3ec5e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1210 microversion: 2.1 time: 0.090667 Oct 06 12:30:11.486931 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 402/811] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:11 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:30:12.416073 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9d1194c3-8c98-497a-86ec-e06a9605193f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:12.418245 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9d1194c3-8c98-497a-86ec-e06a9605193f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:12.425058 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9d1194c3-8c98-497a-86ec-e06a9605193f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:12.425549 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9d1194c3-8c98-497a-86ec-e06a9605193f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:12.425989 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9d1194c3-8c98-497a-86ec-e06a9605193f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:12.426687 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9d1194c3-8c98-497a-86ec-e06a9605193f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:12.427146 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9d1194c3-8c98-497a-86ec-e06a9605193f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:12.427603 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9d1194c3-8c98-497a-86ec-e06a9605193f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:12.456835 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9d1194c3-8c98-497a-86ec-e06a9605193f tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045234 Oct 06 12:30:12.457400 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 410/812] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:30:12 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:30:12.521172 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-88cf232f-4262-44a1-abde-2ed3989341c9 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:12.522695 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-88cf232f-4262-44a1-abde-2ed3989341c9 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:12.532883 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88cf232f-4262-44a1-abde-2ed3989341c9 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:12.533464 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88cf232f-4262-44a1-abde-2ed3989341c9 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:12.534145 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88cf232f-4262-44a1-abde-2ed3989341c9 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:12.535317 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88cf232f-4262-44a1-abde-2ed3989341c9 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:12.536177 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88cf232f-4262-44a1-abde-2ed3989341c9 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:12.536679 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88cf232f-4262-44a1-abde-2ed3989341c9 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:12.536800 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c9b00bcd-45e1-42a4-92d3-ed09de550d5b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:12.537247 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c9b00bcd-45e1-42a4-92d3-ed09de550d5b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:12.545147 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c9b00bcd-45e1-42a4-92d3-ed09de550d5b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:12.545886 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c9b00bcd-45e1-42a4-92d3-ed09de550d5b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:12.546327 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c9b00bcd-45e1-42a4-92d3-ed09de550d5b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:12.547036 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c9b00bcd-45e1-42a4-92d3-ed09de550d5b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:12.547496 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c9b00bcd-45e1-42a4-92d3-ed09de550d5b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:12.548277 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c9b00bcd-45e1-42a4-92d3-ed09de550d5b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:12.574466 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c9b00bcd-45e1-42a4-92d3-ed09de550d5b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Going to try to terminate instance {{(pid=120508) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:30:12.656295 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c9b00bcd-45e1-42a4-92d3-ed09de550d5b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 204 len: 0 microversion: 2.1 time: 0.126702 Oct 06 12:30:12.660411 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 411/813] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:30:12 2022] DELETE /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:30:12.667187 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1f85e039-b7cd-4fd6-8439-3f036d8d017a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:12.668282 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-1f85e039-b7cd-4fd6-8439-3f036d8d017a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:12.674272 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1f85e039-b7cd-4fd6-8439-3f036d8d017a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:12.674912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1f85e039-b7cd-4fd6-8439-3f036d8d017a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:12.675464 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1f85e039-b7cd-4fd6-8439-3f036d8d017a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:12.676254 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1f85e039-b7cd-4fd6-8439-3f036d8d017a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:12.676838 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1f85e039-b7cd-4fd6-8439-3f036d8d017a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:12.677462 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1f85e039-b7cd-4fd6-8439-3f036d8d017a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:12.692869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-88cf232f-4262-44a1-abde-2ed3989341c9 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:12.707936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-88cf232f-4262-44a1-abde-2ed3989341c9 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.188796 Oct 06 12:30:12.710306 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 403/814] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:12 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:12.829542 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-1f85e039-b7cd-4fd6-8439-3f036d8d017a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:12.838232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-1f85e039-b7cd-4fd6-8439-3f036d8d017a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1687 microversion: 2.1 time: 0.176384 Oct 06 12:30:12.838829 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 412/815] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:12 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:13.020449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-5357fb21-a05c-4ff2-b211-b3da3fdfaf00 req-27e27ef9-63b2-4830-976e-80c47f321c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094", "tag": "80e7b3d0-e904-4d2f-8247-bd9a538f244c"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:13.031052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-5357fb21-a05c-4ff2-b211-b3da3fdfaf00 req-27e27ef9-63b2-4830-976e-80c47f321c3d service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:13.031544 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-5357fb21-a05c-4ff2-b211-b3da3fdfaf00 req-27e27ef9-63b2-4830-976e-80c47f321c3d service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:13.031971 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-5357fb21-a05c-4ff2-b211-b3da3fdfaf00 req-27e27ef9-63b2-4830-976e-80c47f321c3d service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:13.042487 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-5357fb21-a05c-4ff2-b211-b3da3fdfaf00 req-27e27ef9-63b2-4830-976e-80c47f321c3d service nova] Creating event network-changed:80e7b3d0-e904-4d2f-8247-bd9a538f244c for instance 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 on hv-cinder-85604 Oct 06 12:30:13.047232 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-5357fb21-a05c-4ff2-b211-b3da3fdfaf00 req-27e27ef9-63b2-4830-976e-80c47f321c3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030564 Oct 06 12:30:13.047848 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 404/816] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:13.732967 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6a6eb37f-6324-47e1-a87e-0bcc761535c4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:13.733571 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-6a6eb37f-6324-47e1-a87e-0bcc761535c4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:13.739939 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6a6eb37f-6324-47e1-a87e-0bcc761535c4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:13.740418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6a6eb37f-6324-47e1-a87e-0bcc761535c4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:13.740846 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6a6eb37f-6324-47e1-a87e-0bcc761535c4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:13.741525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6a6eb37f-6324-47e1-a87e-0bcc761535c4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:13.741978 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6a6eb37f-6324-47e1-a87e-0bcc761535c4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:13.742394 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6a6eb37f-6324-47e1-a87e-0bcc761535c4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:13.862989 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d9010c92-c9ec-4c00-acf6-6f4a44c023aa tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:13.863696 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d9010c92-c9ec-4c00-acf6-6f4a44c023aa tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:13.869728 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d9010c92-c9ec-4c00-acf6-6f4a44c023aa tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:13.870209 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d9010c92-c9ec-4c00-acf6-6f4a44c023aa tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:13.870636 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d9010c92-c9ec-4c00-acf6-6f4a44c023aa tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:13.870920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6a6eb37f-6324-47e1-a87e-0bcc761535c4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:13.871320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d9010c92-c9ec-4c00-acf6-6f4a44c023aa tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:13.871795 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d9010c92-c9ec-4c00-acf6-6f4a44c023aa tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:13.872212 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d9010c92-c9ec-4c00-acf6-6f4a44c023aa tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:13.878783 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-6a6eb37f-6324-47e1-a87e-0bcc761535c4 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.149635 Oct 06 12:30:13.879353 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 413/817] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:13 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:14.004210 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d9010c92-c9ec-4c00-acf6-6f4a44c023aa tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:14.012336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d9010c92-c9ec-4c00-acf6-6f4a44c023aa tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1687 microversion: 2.1 time: 0.154048 Oct 06 12:30:14.012902 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 405/818] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:13 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:30:14.422668 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b5d04672-c610-4b45-b97f-9ee6221b1872 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:14.423168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b5d04672-c610-4b45-b97f-9ee6221b1872 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:14.429190 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b5d04672-c610-4b45-b97f-9ee6221b1872 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:14.429679 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b5d04672-c610-4b45-b97f-9ee6221b1872 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:14.430113 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b5d04672-c610-4b45-b97f-9ee6221b1872 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:14.431299 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b5d04672-c610-4b45-b97f-9ee6221b1872 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:14.431864 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b5d04672-c610-4b45-b97f-9ee6221b1872 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:14.432296 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b5d04672-c610-4b45-b97f-9ee6221b1872 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:14.461482 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b5d04672-c610-4b45-b97f-9ee6221b1872 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-volume_attachments/53c981e4-3e27-4144-acfc-63ccb3318b4c" status: 200 len: 194 microversion: 2.20 time: 0.266987 Oct 06 12:30:14.462078 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 414/819] 10.222.0.33 () {60 vars in 1454 bytes} [Thu Oct 6 12:30:14 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-volume_attachments/53c981e4-3e27-4144-acfc-63ccb3318b4c => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:30:14.531151 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0eb83aa3-f30c-4f19-9254-86784179debc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:14.531679 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0eb83aa3-f30c-4f19-9254-86784179debc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:14.537712 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0eb83aa3-f30c-4f19-9254-86784179debc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:14.538232 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0eb83aa3-f30c-4f19-9254-86784179debc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:14.538700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0eb83aa3-f30c-4f19-9254-86784179debc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:14.539389 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0eb83aa3-f30c-4f19-9254-86784179debc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:14.539884 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0eb83aa3-f30c-4f19-9254-86784179debc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:14.540821 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0eb83aa3-f30c-4f19-9254-86784179debc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:14.619930 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-0eb83aa3-f30c-4f19-9254-86784179debc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lazy-loading 'services' on Instance uuid 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:30:14.689062 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0eb83aa3-f30c-4f19-9254-86784179debc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-volume_attachments/53c981e4-3e27-4144-acfc-63ccb3318b4c" status: 202 len: 0 microversion: 2.20 time: 0.161618 Oct 06 12:30:14.689694 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 406/820] 10.222.0.33 () {60 vars in 1457 bytes} [Thu Oct 6 12:30:14 2022] DELETE /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-volume_attachments/53c981e4-3e27-4144-acfc-63ccb3318b4c => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:30:14.698564 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f8cfe93f-afd0-4496-ad31-cd3528eb887f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:14.700947 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f8cfe93f-afd0-4496-ad31-cd3528eb887f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:14.706848 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8cfe93f-afd0-4496-ad31-cd3528eb887f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:14.707333 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8cfe93f-afd0-4496-ad31-cd3528eb887f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:14.707813 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8cfe93f-afd0-4496-ad31-cd3528eb887f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:14.708504 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8cfe93f-afd0-4496-ad31-cd3528eb887f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:14.708970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8cfe93f-afd0-4496-ad31-cd3528eb887f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:14.709405 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8cfe93f-afd0-4496-ad31-cd3528eb887f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:14.738472 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f8cfe93f-afd0-4496-ad31-cd3528eb887f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044374 Oct 06 12:30:14.739073 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 415/821] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Oct 6 12:30:14 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:30:14.903123 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b66fb151-79ee-4c1d-a962-1bc1b67cd6a8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:14.903854 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b66fb151-79ee-4c1d-a962-1bc1b67cd6a8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:14.910025 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b66fb151-79ee-4c1d-a962-1bc1b67cd6a8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:14.910510 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b66fb151-79ee-4c1d-a962-1bc1b67cd6a8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:14.910946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b66fb151-79ee-4c1d-a962-1bc1b67cd6a8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:14.911666 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b66fb151-79ee-4c1d-a962-1bc1b67cd6a8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:14.912130 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b66fb151-79ee-4c1d-a962-1bc1b67cd6a8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:14.912555 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b66fb151-79ee-4c1d-a962-1bc1b67cd6a8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:15.036609 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4814f1cb-94cd-4976-927e-1bdbbd56b98a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:15.037230 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-4814f1cb-94cd-4976-927e-1bdbbd56b98a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:15.042763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b66fb151-79ee-4c1d-a962-1bc1b67cd6a8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:15.043110 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4814f1cb-94cd-4976-927e-1bdbbd56b98a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:15.043634 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4814f1cb-94cd-4976-927e-1bdbbd56b98a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:15.044076 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4814f1cb-94cd-4976-927e-1bdbbd56b98a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:15.044811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4814f1cb-94cd-4976-927e-1bdbbd56b98a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:15.045272 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4814f1cb-94cd-4976-927e-1bdbbd56b98a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:15.045700 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4814f1cb-94cd-4976-927e-1bdbbd56b98a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:15.050747 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b66fb151-79ee-4c1d-a962-1bc1b67cd6a8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.152296 Oct 06 12:30:15.051319 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 407/822] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:14 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:15.174834 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4814f1cb-94cd-4976-927e-1bdbbd56b98a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:15.183027 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4814f1cb-94cd-4976-927e-1bdbbd56b98a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1687 microversion: 2.1 time: 0.150267 Oct 06 12:30:15.183617 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 416/823] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:15 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:30:15.750386 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7dc6ac4c-fd1b-4f0f-9e67-9fbdfb436ad0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:15.752646 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7dc6ac4c-fd1b-4f0f-9e67-9fbdfb436ad0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:15.758517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7dc6ac4c-fd1b-4f0f-9e67-9fbdfb436ad0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:15.759041 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7dc6ac4c-fd1b-4f0f-9e67-9fbdfb436ad0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:15.759468 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7dc6ac4c-fd1b-4f0f-9e67-9fbdfb436ad0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:15.760173 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7dc6ac4c-fd1b-4f0f-9e67-9fbdfb436ad0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:15.760624 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7dc6ac4c-fd1b-4f0f-9e67-9fbdfb436ad0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:15.761042 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7dc6ac4c-fd1b-4f0f-9e67-9fbdfb436ad0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:15.790086 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7dc6ac4c-fd1b-4f0f-9e67-9fbdfb436ad0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043592 Oct 06 12:30:15.791177 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 408/824] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Oct 6 12:30:15 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:30:16.073673 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b16ac76b-2ee8-474b-b95a-8493bf57a85c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:16.074365 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b16ac76b-2ee8-474b-b95a-8493bf57a85c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:16.081153 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b16ac76b-2ee8-474b-b95a-8493bf57a85c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:16.081703 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b16ac76b-2ee8-474b-b95a-8493bf57a85c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:16.082396 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b16ac76b-2ee8-474b-b95a-8493bf57a85c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:16.083213 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b16ac76b-2ee8-474b-b95a-8493bf57a85c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:16.083719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b16ac76b-2ee8-474b-b95a-8493bf57a85c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:16.084153 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b16ac76b-2ee8-474b-b95a-8493bf57a85c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:16.104899 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:16.206202 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-36287cff-0351-496b-bc9e-f926e16cfa22 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:16.206811 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-36287cff-0351-496b-bc9e-f926e16cfa22 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:16.212901 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36287cff-0351-496b-bc9e-f926e16cfa22 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:16.213392 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36287cff-0351-496b-bc9e-f926e16cfa22 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:16.214278 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36287cff-0351-496b-bc9e-f926e16cfa22 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:16.214983 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36287cff-0351-496b-bc9e-f926e16cfa22 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:16.215441 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36287cff-0351-496b-bc9e-f926e16cfa22 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:16.215900 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-36287cff-0351-496b-bc9e-f926e16cfa22 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:16.221312 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b16ac76b-2ee8-474b-b95a-8493bf57a85c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:16.229530 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b16ac76b-2ee8-474b-b95a-8493bf57a85c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.160349 Oct 06 12:30:16.230110 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 417/825] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:16 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:16.343330 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-36287cff-0351-496b-bc9e-f926e16cfa22 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:16.350965 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-36287cff-0351-496b-bc9e-f926e16cfa22 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1687 microversion: 2.1 time: 0.148602 Oct 06 12:30:16.351549 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 409/826] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:16 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:30:16.803191 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5460114b-9515-4c73-b9d2-6a9a86c532a1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:16.805402 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5460114b-9515-4c73-b9d2-6a9a86c532a1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:16.811793 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5460114b-9515-4c73-b9d2-6a9a86c532a1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:16.812276 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5460114b-9515-4c73-b9d2-6a9a86c532a1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:16.812704 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5460114b-9515-4c73-b9d2-6a9a86c532a1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:16.813394 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5460114b-9515-4c73-b9d2-6a9a86c532a1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:16.813850 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5460114b-9515-4c73-b9d2-6a9a86c532a1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:16.814271 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5460114b-9515-4c73-b9d2-6a9a86c532a1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:16.843267 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5460114b-9515-4c73-b9d2-6a9a86c532a1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043752 Oct 06 12:30:16.843862 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 418/827] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Oct 6 12:30:16 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:30:17.256579 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d98dbb32-7c5f-433a-9857-3adce74d059f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:17.257948 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d98dbb32-7c5f-433a-9857-3adce74d059f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:17.265349 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d98dbb32-7c5f-433a-9857-3adce74d059f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:17.266171 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d98dbb32-7c5f-433a-9857-3adce74d059f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:17.266935 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d98dbb32-7c5f-433a-9857-3adce74d059f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:17.267893 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d98dbb32-7c5f-433a-9857-3adce74d059f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:17.268587 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d98dbb32-7c5f-433a-9857-3adce74d059f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:17.269099 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d98dbb32-7c5f-433a-9857-3adce74d059f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:17.377334 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7e603417-26ee-40a0-bdcd-89d95a927f92 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:17.378296 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7e603417-26ee-40a0-bdcd-89d95a927f92 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:17.389809 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e603417-26ee-40a0-bdcd-89d95a927f92 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:17.390408 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e603417-26ee-40a0-bdcd-89d95a927f92 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:17.391170 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e603417-26ee-40a0-bdcd-89d95a927f92 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:17.392286 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e603417-26ee-40a0-bdcd-89d95a927f92 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:17.393580 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e603417-26ee-40a0-bdcd-89d95a927f92 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:17.394385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e603417-26ee-40a0-bdcd-89d95a927f92 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:17.563202 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d98dbb32-7c5f-433a-9857-3adce74d059f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:17.570954 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d98dbb32-7c5f-433a-9857-3adce74d059f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.321090 Oct 06 12:30:17.583534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 410/828] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:17 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:17.633867 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7e603417-26ee-40a0-bdcd-89d95a927f92 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:17.642261 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7e603417-26ee-40a0-bdcd-89d95a927f92 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1687 microversion: 2.1 time: 0.270842 Oct 06 12:30:17.642842 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 419/829] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:17 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1687 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:17.856497 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5d6b5f79-ebe1-4ee1-90a2-74a40df7cd1e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:17.858773 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5d6b5f79-ebe1-4ee1-90a2-74a40df7cd1e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:17.864625 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5d6b5f79-ebe1-4ee1-90a2-74a40df7cd1e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:17.865101 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5d6b5f79-ebe1-4ee1-90a2-74a40df7cd1e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:17.865527 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5d6b5f79-ebe1-4ee1-90a2-74a40df7cd1e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:17.866207 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5d6b5f79-ebe1-4ee1-90a2-74a40df7cd1e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:17.866652 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5d6b5f79-ebe1-4ee1-90a2-74a40df7cd1e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:17.867071 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5d6b5f79-ebe1-4ee1-90a2-74a40df7cd1e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:17.895839 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5d6b5f79-ebe1-4ee1-90a2-74a40df7cd1e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043878 Oct 06 12:30:17.896396 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 411/830] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Oct 6 12:30:17 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:17.961282 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-852d9a51-9f83-46ca-bb3f-380aa2d66362 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:17.962237 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-852d9a51-9f83-46ca-bb3f-380aa2d66362 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:17.968201 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-852d9a51-9f83-46ca-bb3f-380aa2d66362 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:17.968693 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-852d9a51-9f83-46ca-bb3f-380aa2d66362 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:17.969126 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-852d9a51-9f83-46ca-bb3f-380aa2d66362 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:17.969831 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-852d9a51-9f83-46ca-bb3f-380aa2d66362 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:17.970293 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-852d9a51-9f83-46ca-bb3f-380aa2d66362 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:17.970716 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-852d9a51-9f83-46ca-bb3f-380aa2d66362 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:17.997715 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-852d9a51-9f83-46ca-bb3f-380aa2d66362 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Going to try to terminate instance {{(pid=120508) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:30:18.067079 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-9fbd4042-7daf-47e3-b1c2-1e3d8aaca22e req-0914d3be-7471-49a5-b129-3e0cdd1f015b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1620fb3a-f872-41f2-83d2-909fbe71f438", "name": "network-vif-deleted", "tag": "02cb1ceb-4a00-4f6e-8fe3-e8409283f314"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:18.077697 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-9fbd4042-7daf-47e3-b1c2-1e3d8aaca22e req-0914d3be-7471-49a5-b129-3e0cdd1f015b service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:18.078442 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-9fbd4042-7daf-47e3-b1c2-1e3d8aaca22e req-0914d3be-7471-49a5-b129-3e0cdd1f015b service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:18.079399 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-9fbd4042-7daf-47e3-b1c2-1e3d8aaca22e req-0914d3be-7471-49a5-b129-3e0cdd1f015b service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:18.084752 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-852d9a51-9f83-46ca-bb3f-380aa2d66362 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 204 len: 0 microversion: 2.20 time: 0.127158 Oct 06 12:30:18.085529 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 420/831] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Oct 6 12:30:17 2022] DELETE /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:30:18.095028 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-30ff750f-b3b0-4862-8f51-87a022720af9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:18.095926 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-30ff750f-b3b0-4862-8f51-87a022720af9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:18.096429 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-9fbd4042-7daf-47e3-b1c2-1e3d8aaca22e req-0914d3be-7471-49a5-b129-3e0cdd1f015b service nova] Creating event network-vif-deleted:02cb1ceb-4a00-4f6e-8fe3-e8409283f314 for instance 1620fb3a-f872-41f2-83d2-909fbe71f438 on hv-cinder-85604 Oct 06 12:30:18.101733 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-9fbd4042-7daf-47e3-b1c2-1e3d8aaca22e req-0914d3be-7471-49a5-b129-3e0cdd1f015b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109924 Oct 06 12:30:18.102546 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-30ff750f-b3b0-4862-8f51-87a022720af9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:18.103038 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-30ff750f-b3b0-4862-8f51-87a022720af9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:18.103264 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 412/832] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:18.103908 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-30ff750f-b3b0-4862-8f51-87a022720af9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:18.104732 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-30ff750f-b3b0-4862-8f51-87a022720af9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:18.105194 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-30ff750f-b3b0-4862-8f51-87a022720af9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:18.105786 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-30ff750f-b3b0-4862-8f51-87a022720af9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:18.260594 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-30ff750f-b3b0-4862-8f51-87a022720af9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:18.269554 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-30ff750f-b3b0-4862-8f51-87a022720af9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:18.271149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-30ff750f-b3b0-4862-8f51-87a022720af9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:18.272698 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-30ff750f-b3b0-4862-8f51-87a022720af9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1721 microversion: 2.20 time: 0.181955 Oct 06 12:30:18.273346 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 421/833] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:18 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:18.594761 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-1c07a44a-688a-4366-bdc7-03f409ed3859 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:18.595499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-1c07a44a-688a-4366-bdc7-03f409ed3859 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:18.602370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1c07a44a-688a-4366-bdc7-03f409ed3859 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:18.603370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1c07a44a-688a-4366-bdc7-03f409ed3859 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:18.603850 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1c07a44a-688a-4366-bdc7-03f409ed3859 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:18.604548 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1c07a44a-688a-4366-bdc7-03f409ed3859 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:18.605009 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1c07a44a-688a-4366-bdc7-03f409ed3859 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:18.605435 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1c07a44a-688a-4366-bdc7-03f409ed3859 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:18.667740 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-50a0bf3a-bf46-4d23-9e33-32a705e8e636 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:18.668521 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-50a0bf3a-bf46-4d23-9e33-32a705e8e636 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:18.675048 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-50a0bf3a-bf46-4d23-9e33-32a705e8e636 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:18.675701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-50a0bf3a-bf46-4d23-9e33-32a705e8e636 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:18.676291 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-50a0bf3a-bf46-4d23-9e33-32a705e8e636 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:18.677716 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-50a0bf3a-bf46-4d23-9e33-32a705e8e636 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:18.678380 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-50a0bf3a-bf46-4d23-9e33-32a705e8e636 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:18.679675 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-50a0bf3a-bf46-4d23-9e33-32a705e8e636 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:18.757626 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-50a0bf3a-bf46-4d23-9e33-32a705e8e636 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:18.768421 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-1c07a44a-688a-4366-bdc7-03f409ed3859 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:18.772034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:18.773288 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-50a0bf3a-bf46-4d23-9e33-32a705e8e636 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1329 microversion: 2.1 time: 0.110105 Oct 06 12:30:18.773794 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 422/834] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:18 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1329 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:18.778946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-1c07a44a-688a-4366-bdc7-03f409ed3859 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.188395 Oct 06 12:30:18.779530 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 413/835] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:18 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:19.298268 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ac643295-3c1d-4b18-8cc5-bda2cb5f3e62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:19.298885 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ac643295-3c1d-4b18-8cc5-bda2cb5f3e62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:19.300967 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:19.301636 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=6 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:19.308567 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ac643295-3c1d-4b18-8cc5-bda2cb5f3e62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:19.308948 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ac643295-3c1d-4b18-8cc5-bda2cb5f3e62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:19.309369 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ac643295-3c1d-4b18-8cc5-bda2cb5f3e62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:19.310062 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ac643295-3c1d-4b18-8cc5-bda2cb5f3e62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:19.310602 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ac643295-3c1d-4b18-8cc5-bda2cb5f3e62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:19.310927 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ac643295-3c1d-4b18-8cc5-bda2cb5f3e62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:19.513830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c6f11627-c4ba-42a8-bb46-7a977d8df79a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:19.516063 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c6f11627-c4ba-42a8-bb46-7a977d8df79a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:19.518675 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:19.527631 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6f11627-c4ba-42a8-bb46-7a977d8df79a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:19.528296 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6f11627-c4ba-42a8-bb46-7a977d8df79a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:19.528779 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6f11627-c4ba-42a8-bb46-7a977d8df79a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:19.529540 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6f11627-c4ba-42a8-bb46-7a977d8df79a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:19.530188 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6f11627-c4ba-42a8-bb46-7a977d8df79a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:19.530616 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6f11627-c4ba-42a8-bb46-7a977d8df79a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:19.564431 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c6f11627-c4ba-42a8-bb46-7a977d8df79a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054580 Oct 06 12:30:19.565009 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 414/836] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:30:19 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 06 12:30:19.631973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e06293bb-27e3-432c-871a-e93d905cb8ed tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:19.632649 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e06293bb-27e3-432c-871a-e93d905cb8ed tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:19.639194 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e06293bb-27e3-432c-871a-e93d905cb8ed tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:19.639797 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e06293bb-27e3-432c-871a-e93d905cb8ed tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:19.640301 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e06293bb-27e3-432c-871a-e93d905cb8ed tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:19.641090 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e06293bb-27e3-432c-871a-e93d905cb8ed tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:19.641614 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e06293bb-27e3-432c-871a-e93d905cb8ed tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:19.642109 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e06293bb-27e3-432c-871a-e93d905cb8ed tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:19.668539 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e06293bb-27e3-432c-871a-e93d905cb8ed tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Going to try to terminate instance {{(pid=120509) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:30:19.670265 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ac643295-3c1d-4b18-8cc5-bda2cb5f3e62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:19.678877 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ac643295-3c1d-4b18-8cc5-bda2cb5f3e62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:19.680385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ac643295-3c1d-4b18-8cc5-bda2cb5f3e62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:19.681546 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ac643295-3c1d-4b18-8cc5-bda2cb5f3e62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1721 microversion: 2.20 time: 0.387268 Oct 06 12:30:19.682199 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 423/837] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:19 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1721 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:19.742746 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e06293bb-27e3-432c-871a-e93d905cb8ed tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 204 len: 0 microversion: 2.1 time: 0.114408 Oct 06 12:30:19.743320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 415/838] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:30:19 2022] DELETE /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 12:30:19.751666 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-26def79d-7590-46dd-a852-da8bf558cfe9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:19.752317 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-26def79d-7590-46dd-a852-da8bf558cfe9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:19.758217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-26def79d-7590-46dd-a852-da8bf558cfe9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:19.759394 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-26def79d-7590-46dd-a852-da8bf558cfe9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:19.759863 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-26def79d-7590-46dd-a852-da8bf558cfe9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:19.760558 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-26def79d-7590-46dd-a852-da8bf558cfe9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:19.761019 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-26def79d-7590-46dd-a852-da8bf558cfe9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:19.761450 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-26def79d-7590-46dd-a852-da8bf558cfe9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:19.798197 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5df03476-9ab0-46c3-aa14-f478c9a4bbed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:19.798809 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5df03476-9ab0-46c3-aa14-f478c9a4bbed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:19.805005 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5df03476-9ab0-46c3-aa14-f478c9a4bbed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:19.805498 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5df03476-9ab0-46c3-aa14-f478c9a4bbed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:19.805937 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5df03476-9ab0-46c3-aa14-f478c9a4bbed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:19.806631 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5df03476-9ab0-46c3-aa14-f478c9a4bbed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:19.807085 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5df03476-9ab0-46c3-aa14-f478c9a4bbed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:19.807530 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5df03476-9ab0-46c3-aa14-f478c9a4bbed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:19.879624 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5df03476-9ab0-46c3-aa14-f478c9a4bbed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:19.888726 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5df03476-9ab0-46c3-aa14-f478c9a4bbed tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1329 microversion: 2.1 time: 0.094791 Oct 06 12:30:19.889321 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 416/839] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:19 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1329 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:30:19.893811 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-817467f4-16b1-46af-b2b2-0a87eb6b5b63 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:19.894568 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-817467f4-16b1-46af-b2b2-0a87eb6b5b63 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:19.901557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-817467f4-16b1-46af-b2b2-0a87eb6b5b63 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:19.902053 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-817467f4-16b1-46af-b2b2-0a87eb6b5b63 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:19.902494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-817467f4-16b1-46af-b2b2-0a87eb6b5b63 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:19.903216 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-817467f4-16b1-46af-b2b2-0a87eb6b5b63 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:19.903705 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-817467f4-16b1-46af-b2b2-0a87eb6b5b63 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:19.904333 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-817467f4-16b1-46af-b2b2-0a87eb6b5b63 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:19.921864 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-26def79d-7590-46dd-a852-da8bf558cfe9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:19.929463 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-26def79d-7590-46dd-a852-da8bf558cfe9 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1674 microversion: 2.1 time: 0.181688 Oct 06 12:30:19.930035 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 424/840] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:19 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:20.036015 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-817467f4-16b1-46af-b2b2-0a87eb6b5b63 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:20.044188 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-817467f4-16b1-46af-b2b2-0a87eb6b5b63 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.153926 Oct 06 12:30:20.044755 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 417/841] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:19 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:20.707292 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a49ef498-630b-457f-87d2-9ed34dd71382 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:20.707951 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a49ef498-630b-457f-87d2-9ed34dd71382 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:20.714289 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a49ef498-630b-457f-87d2-9ed34dd71382 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:20.714775 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a49ef498-630b-457f-87d2-9ed34dd71382 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:20.715211 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a49ef498-630b-457f-87d2-9ed34dd71382 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:20.715934 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a49ef498-630b-457f-87d2-9ed34dd71382 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:20.716394 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a49ef498-630b-457f-87d2-9ed34dd71382 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:20.716818 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a49ef498-630b-457f-87d2-9ed34dd71382 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:20.842946 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a49ef498-630b-457f-87d2-9ed34dd71382 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:20.850947 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a49ef498-630b-457f-87d2-9ed34dd71382 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:20.852427 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a49ef498-630b-457f-87d2-9ed34dd71382 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:20.853595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a49ef498-630b-457f-87d2-9ed34dd71382 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1721 microversion: 2.20 time: 0.150239 Oct 06 12:30:20.854154 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 425/842] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:20 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:20.913755 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-169e275c-429b-4b75-94bb-d56c2f473b35 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:20.914384 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-169e275c-429b-4b75-94bb-d56c2f473b35 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:20.921255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-169e275c-429b-4b75-94bb-d56c2f473b35 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:20.921738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-169e275c-429b-4b75-94bb-d56c2f473b35 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:20.922171 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-169e275c-429b-4b75-94bb-d56c2f473b35 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:20.922852 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-169e275c-429b-4b75-94bb-d56c2f473b35 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:20.923304 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-169e275c-429b-4b75-94bb-d56c2f473b35 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:20.923753 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-169e275c-429b-4b75-94bb-d56c2f473b35 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:20.954119 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-169e275c-429b-4b75-94bb-d56c2f473b35 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:20.954284 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5a88f666-0323-400f-a313-08ea753c5886 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:20.954520 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-169e275c-429b-4b75-94bb-d56c2f473b35 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:20.954641 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5a88f666-0323-400f-a313-08ea753c5886 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:20.954951 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-169e275c-429b-4b75-94bb-d56c2f473b35 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:20.955394 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-169e275c-429b-4b75-94bb-d56c2f473b35 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lazy-loading 'fault' on Instance uuid 1620fb3a-f872-41f2-83d2-909fbe71f438 {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:30:20.960414 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5a88f666-0323-400f-a313-08ea753c5886 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:20.960902 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5a88f666-0323-400f-a313-08ea753c5886 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:20.961341 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5a88f666-0323-400f-a313-08ea753c5886 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:20.962030 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5a88f666-0323-400f-a313-08ea753c5886 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:20.962485 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5a88f666-0323-400f-a313-08ea753c5886 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:20.962908 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5a88f666-0323-400f-a313-08ea753c5886 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:21.000367 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-169e275c-429b-4b75-94bb-d56c2f473b35 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:21.008303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-169e275c-429b-4b75-94bb-d56c2f473b35 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1334 microversion: 2.1 time: 0.098339 Oct 06 12:30:21.008885 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 418/843] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:20 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:21.066692 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f0ee6f5e-490e-4a09-b078-4efbdc75eb3f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:21.067343 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f0ee6f5e-490e-4a09-b078-4efbdc75eb3f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:21.074001 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f0ee6f5e-490e-4a09-b078-4efbdc75eb3f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:21.074559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f0ee6f5e-490e-4a09-b078-4efbdc75eb3f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:21.075002 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f0ee6f5e-490e-4a09-b078-4efbdc75eb3f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:21.075731 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f0ee6f5e-490e-4a09-b078-4efbdc75eb3f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:21.076216 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f0ee6f5e-490e-4a09-b078-4efbdc75eb3f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:21.076640 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f0ee6f5e-490e-4a09-b078-4efbdc75eb3f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:21.148883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-5a88f666-0323-400f-a313-08ea753c5886 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:21.157037 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5a88f666-0323-400f-a313-08ea753c5886 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1674 microversion: 2.1 time: 0.206748 Oct 06 12:30:21.171904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 426/844] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:20 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1674 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:30:21.246906 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f0ee6f5e-490e-4a09-b078-4efbdc75eb3f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:21.254724 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f0ee6f5e-490e-4a09-b078-4efbdc75eb3f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.191838 Oct 06 12:30:21.255293 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 419/845] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:21 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:30:21.879043 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d5092d19-c45c-4d61-9b2e-c380737e5dc0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:21.879794 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d5092d19-c45c-4d61-9b2e-c380737e5dc0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:21.886350 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d5092d19-c45c-4d61-9b2e-c380737e5dc0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:21.886934 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d5092d19-c45c-4d61-9b2e-c380737e5dc0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:21.887436 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d5092d19-c45c-4d61-9b2e-c380737e5dc0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:21.888230 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d5092d19-c45c-4d61-9b2e-c380737e5dc0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:21.888773 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d5092d19-c45c-4d61-9b2e-c380737e5dc0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:21.889412 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d5092d19-c45c-4d61-9b2e-c380737e5dc0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:21.990202 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d5092d19-c45c-4d61-9b2e-c380737e5dc0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:22.001710 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d5092d19-c45c-4d61-9b2e-c380737e5dc0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:22.003451 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d5092d19-c45c-4d61-9b2e-c380737e5dc0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:22.004872 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d5092d19-c45c-4d61-9b2e-c380737e5dc0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1654 microversion: 2.20 time: 0.129750 Oct 06 12:30:22.005638 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 427/846] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:21 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1654 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:22.035434 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a4436866-7bb4-4c66-ae51-07f7954002a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:22.036104 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a4436866-7bb4-4c66-ae51-07f7954002a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:22.048403 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a4436866-7bb4-4c66-ae51-07f7954002a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:22.048896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a4436866-7bb4-4c66-ae51-07f7954002a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:22.049330 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a4436866-7bb4-4c66-ae51-07f7954002a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:22.050030 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a4436866-7bb4-4c66-ae51-07f7954002a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:22.050483 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a4436866-7bb4-4c66-ae51-07f7954002a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:22.050899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a4436866-7bb4-4c66-ae51-07f7954002a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:22.089156 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a4436866-7bb4-4c66-ae51-07f7954002a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:22.089906 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a4436866-7bb4-4c66-ae51-07f7954002a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:22.090503 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a4436866-7bb4-4c66-ae51-07f7954002a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:22.091131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-a4436866-7bb4-4c66-ae51-07f7954002a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lazy-loading 'fault' on Instance uuid 1620fb3a-f872-41f2-83d2-909fbe71f438 {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:30:22.157289 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a4436866-7bb4-4c66-ae51-07f7954002a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:22.167759 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a4436866-7bb4-4c66-ae51-07f7954002a4 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 200 len: 1334 microversion: 2.1 time: 0.139652 Oct 06 12:30:22.168699 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 420/847] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:22 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 1334 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:22.192067 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ae8cb8b9-5195-482b-8154-a074789d594a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:22.193407 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ae8cb8b9-5195-482b-8154-a074789d594a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:22.200689 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae8cb8b9-5195-482b-8154-a074789d594a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:22.201263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae8cb8b9-5195-482b-8154-a074789d594a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:22.201916 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae8cb8b9-5195-482b-8154-a074789d594a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:22.202851 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae8cb8b9-5195-482b-8154-a074789d594a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:22.203379 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae8cb8b9-5195-482b-8154-a074789d594a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:22.203902 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ae8cb8b9-5195-482b-8154-a074789d594a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:22.275974 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ae8cb8b9-5195-482b-8154-a074789d594a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:22.279600 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e89bb569-f3f2-4815-b897-eb04a3e615ba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:22.280297 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e89bb569-f3f2-4815-b897-eb04a3e615ba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:22.287179 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e89bb569-f3f2-4815-b897-eb04a3e615ba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:22.294692 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ae8cb8b9-5195-482b-8154-a074789d594a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 200 len: 1607 microversion: 2.1 time: 0.109479 Oct 06 12:30:22.296565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 428/848] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:22 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 1607 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:22.299938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e89bb569-f3f2-4815-b897-eb04a3e615ba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:22.301212 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e89bb569-f3f2-4815-b897-eb04a3e615ba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:22.302156 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e89bb569-f3f2-4815-b897-eb04a3e615ba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:22.304057 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e89bb569-f3f2-4815-b897-eb04a3e615ba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:22.304640 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e89bb569-f3f2-4815-b897-eb04a3e615ba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:22.363126 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-7938f637-ac5f-476f-bb32-b8bee3bef490 req-6f01b2bf-b4e6-44ca-8149-32166b59db2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c26e82-69b3-4ffa-97e2-7ca36b941c1f", "name": "network-vif-deleted", "tag": "2f5ac9b9-0c5c-4565-96ae-3de71a11dddd"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:22.379243 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-7938f637-ac5f-476f-bb32-b8bee3bef490 req-6f01b2bf-b4e6-44ca-8149-32166b59db2f service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:22.379803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-7938f637-ac5f-476f-bb32-b8bee3bef490 req-6f01b2bf-b4e6-44ca-8149-32166b59db2f service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:22.380306 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-7938f637-ac5f-476f-bb32-b8bee3bef490 req-6f01b2bf-b4e6-44ca-8149-32166b59db2f service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:22.394905 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-7938f637-ac5f-476f-bb32-b8bee3bef490 req-6f01b2bf-b4e6-44ca-8149-32166b59db2f service nova] Creating event network-vif-deleted:2f5ac9b9-0c5c-4565-96ae-3de71a11dddd for instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f on hv-cinder-85604 Oct 06 12:30:22.403131 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-7938f637-ac5f-476f-bb32-b8bee3bef490 req-6f01b2bf-b4e6-44ca-8149-32166b59db2f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042955 Oct 06 12:30:22.408741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 429/849] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:22.565037 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-5ddeb823-c292-4ab9-85d8-c14c750a3170 req-365beeb9-cb56-452c-afd4-af2d550077b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b1825b8-e10c-4c5b-adf9-3456c97a68e2", "name": "network-vif-deleted", "tag": "178adb30-0da6-4996-903a-4ee020de2a0a"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:22.591150 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-5ddeb823-c292-4ab9-85d8-c14c750a3170 req-365beeb9-cb56-452c-afd4-af2d550077b4 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:22.591893 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-5ddeb823-c292-4ab9-85d8-c14c750a3170 req-365beeb9-cb56-452c-afd4-af2d550077b4 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:22.592765 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-5ddeb823-c292-4ab9-85d8-c14c750a3170 req-365beeb9-cb56-452c-afd4-af2d550077b4 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:22.628955 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-5ddeb823-c292-4ab9-85d8-c14c750a3170 req-365beeb9-cb56-452c-afd4-af2d550077b4 service nova] Creating event network-vif-deleted:178adb30-0da6-4996-903a-4ee020de2a0a for instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 on hv-cinder-85604 Oct 06 12:30:22.648921 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-5ddeb823-c292-4ab9-85d8-c14c750a3170 req-365beeb9-cb56-452c-afd4-af2d550077b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074849 Oct 06 12:30:22.649622 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 430/850] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:22.730743 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e89bb569-f3f2-4815-b897-eb04a3e615ba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:22.743670 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e89bb569-f3f2-4815-b897-eb04a3e615ba tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.469179 Oct 06 12:30:22.744545 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 421/851] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:22 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:23.041545 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:23.042153 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:23.048439 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:23.048928 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:23.049366 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:23.050060 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:23.050639 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:23.051074 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:23.082720 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:23.083471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:23.084104 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:23.084748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lazy-loading 'fault' on Instance uuid 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:30:23.129083 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:23.142749 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:23.144993 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:23.146407 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-25f51739-f594-4431-be6d-3aa554d48b54 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 200 len: 1370 microversion: 2.20 time: 0.110418 Oct 06 12:30:23.168784 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 431/852] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:23 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 1370 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:23.199151 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-566e3adf-9731-4c53-94ba-25bed95d15ab tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:23.200411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-566e3adf-9731-4c53-94ba-25bed95d15ab tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 1620fb3a-f872-41f2-83d2-909fbe71f438] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:23.220763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-566e3adf-9731-4c53-94ba-25bed95d15ab tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:23.226016 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-566e3adf-9731-4c53-94ba-25bed95d15ab tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:23.227150 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-566e3adf-9731-4c53-94ba-25bed95d15ab tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:23.228333 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-566e3adf-9731-4c53-94ba-25bed95d15ab tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:23.228991 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-566e3adf-9731-4c53-94ba-25bed95d15ab tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:23.229968 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-566e3adf-9731-4c53-94ba-25bed95d15ab tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:23.264479 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-566e3adf-9731-4c53-94ba-25bed95d15ab tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] HTTP exception thrown: Instance 1620fb3a-f872-41f2-83d2-909fbe71f438 could not be found. Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-566e3adf-9731-4c53-94ba-25bed95d15ab tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Request method failure captured: Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 HTTP/1.1 Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsh-PJ9xvBXdfQe_7UormM1Qyx0qepQqe1wI78PUDz3eEOb52qjqvlvg_d8nEkHrVtXCoBdXqhuEix6aY08jzJfIy6nrnz7MkzwZ2sOKibXZ2ZU4L1xUu_NrfA_ABN8p0EemOJk_E32lA71Qz_KuMtDmQk38cZgrdfRfT30A7Fp6Ci4 Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 9138bc89f5204975a18156097530643a Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-754252330 Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:30:23.266492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:30:23.268018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9138bc89f5204975a18156097530643a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9138bc89f5204975a18156097530643a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9138bc89f5204975a18156097530643a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9138bc89f5204975a18156097530643a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:30:23.268018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-ServerRescueNegativeTestJSON-754252330 Oct 06 12:30:23.268018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 9138bc89f5204975a18156097530643a Oct 06 12:30:23.268018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-754252330 Oct 06 12:30:23.268018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-ServerRescueNegativeTestJSON-754252330-project Oct 06 12:30:23.268018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:30:23.268018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:30:23.268018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 1f4cbe342b2c4378b3c0ab2f1cd55260 Oct 06 12:30:23.268018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-ServerRescueNegativeTestJSON-754252330-project Oct 06 12:30:23.268018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:30:23.268018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 1620fb3a-f872-41f2-83d2-909fbe71f438 could not be found. Oct 06 12:30:23.268018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '1620fb3a-f872-41f2-83d2-909fbe71f438'} Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1620fb3a-f872-41f2-83d2-909fbe71f438 could not be found. Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:30:23.268826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1620fb3a-f872-41f2-83d2-909fbe71f438 could not be found. Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1620fb3a-f872-41f2-83d2-909fbe71f438 could not be found. Oct 06 12:30:23.270851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:23.275979 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-566e3adf-9731-4c53-94ba-25bed95d15ab tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Returning 404 to user: Instance 1620fb3a-f872-41f2-83d2-909fbe71f438 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:30:23.275979 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-566e3adf-9731-4c53-94ba-25bed95d15ab tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438" status: 404 len: 111 microversion: 2.1 time: 0.076140 Oct 06 12:30:23.275979 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 422/853] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:23 2022] GET /compute/v2.1/servers/1620fb3a-f872-41f2-83d2-909fbe71f438 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:30:23.281017 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-fc13c76d-bb3d-49f2-8999-ba41eb504b64 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '.version_select at 0x7f03ae3009d0>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:23.314912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-fc13c76d-bb3d-49f2-8999-ba41eb504b64 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-89683590" status: 202 len: 0 microversion: 2.1 time: 0.037997 Oct 06 12:30:23.318981 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 432/854] 10.222.0.33 () {58 vars in 1215 bytes} [Thu Oct 6 12:30:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-89683590 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:30:23.324150 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d822fe33-5170-4bc6-bb8e-f1548b344d70 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:23.325307 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d822fe33-5170-4bc6-bb8e-f1548b344d70 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:23.335222 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d822fe33-5170-4bc6-bb8e-f1548b344d70 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:23.335758 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d822fe33-5170-4bc6-bb8e-f1548b344d70 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:23.336227 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d822fe33-5170-4bc6-bb8e-f1548b344d70 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:23.337924 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d822fe33-5170-4bc6-bb8e-f1548b344d70 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:23.338377 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d822fe33-5170-4bc6-bb8e-f1548b344d70 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:23.338976 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d822fe33-5170-4bc6-bb8e-f1548b344d70 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:23.374405 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-d822fe33-5170-4bc6-bb8e-f1548b344d70 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] HTTP exception thrown: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d822fe33-5170-4bc6-bb8e-f1548b344d70 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Request method failure captured: Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f HTTP/1.1 Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsh-dA-onsGd0gQTmqItM4pMONWdRZo80FOc6mfr9pYSye5FqjXyW74rk89eNToiFIk1akbz2oKSdcVQ1-Zmp9C90P3NwZgB6ZJYdrcy4qyzVqrVlQkiV4r3YxDOAofq4A-zNG7UKLRqszPrg8bhUKYusJOEryUX42mDPPfup9MgiNY Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 828d3459cdd641d98772383edfe3268f Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:30:23.376028 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:30:23.377628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/828d3459cdd641d98772383edfe3268f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_828d3459cdd641d98772383edfe3268f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/828d3459cdd641d98772383edfe3268f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/828d3459cdd641d98772383edfe3268f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:30:23.377628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:30:23.377628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 828d3459cdd641d98772383edfe3268f Oct 06 12:30:23.377628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:30:23.377628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-AttachVolumeTestJSON-1894626907-project Oct 06 12:30:23.377628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:30:23.377628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:30:23.377628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 3066c1c9c79942c289b733d886d9fd0f Oct 06 12:30:23.377628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-AttachVolumeTestJSON-1894626907-project Oct 06 12:30:23.377628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:30:23.377628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. Oct 06 12:30:23.377628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': 'b7c26e82-69b3-4ffa-97e2-7ca36b941c1f'} Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:30:23.378656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. Oct 06 12:30:23.380213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:23.381534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d822fe33-5170-4bc6-bb8e-f1548b344d70 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Returning 404 to user: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:30:23.381534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d822fe33-5170-4bc6-bb8e-f1548b344d70 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 404 len: 111 microversion: 2.1 time: 0.061178 Oct 06 12:30:23.385616 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 423/855] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:23 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:30:23.395333 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ef4edf67-019d-41da-82a0-29f5d32d6ab7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '.version_select at 0x7f03ae2df5e0>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:23.428238 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ef4edf67-019d-41da-82a0-29f5d32d6ab7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871174398" status: 202 len: 0 microversion: 2.1 time: 0.037260 Oct 06 12:30:23.431533 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 433/856] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Oct 6 12:30:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871174398 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 12:30:23.768364 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-91d4de43-c59c-4094-a712-f9c256960f14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:23.769130 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-91d4de43-c59c-4094-a712-f9c256960f14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:23.780168 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91d4de43-c59c-4094-a712-f9c256960f14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:23.784142 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91d4de43-c59c-4094-a712-f9c256960f14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:23.785501 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91d4de43-c59c-4094-a712-f9c256960f14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:23.786587 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91d4de43-c59c-4094-a712-f9c256960f14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:23.790830 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91d4de43-c59c-4094-a712-f9c256960f14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:23.791775 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91d4de43-c59c-4094-a712-f9c256960f14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:24.075970 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-91d4de43-c59c-4094-a712-f9c256960f14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:24.087246 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-91d4de43-c59c-4094-a712-f9c256960f14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.322625 Oct 06 12:30:24.088142 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 424/857] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:23 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:24.176553 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b8ac4e33-403b-4363-acec-68e63fcf2b1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:24.177290 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b8ac4e33-403b-4363-acec-68e63fcf2b1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:24.198360 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:24.204348 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b8ac4e33-403b-4363-acec-68e63fcf2b1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:24.205152 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b8ac4e33-403b-4363-acec-68e63fcf2b1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:24.205823 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b8ac4e33-403b-4363-acec-68e63fcf2b1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:24.206671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b8ac4e33-403b-4363-acec-68e63fcf2b1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:24.207398 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b8ac4e33-403b-4363-acec-68e63fcf2b1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:24.208220 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b8ac4e33-403b-4363-acec-68e63fcf2b1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:24.231647 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-b8ac4e33-403b-4363-acec-68e63fcf2b1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] HTTP exception thrown: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b8ac4e33-403b-4363-acec-68e63fcf2b1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Request method failure captured: Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 HTTP/1.1 Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPskLXklXJxJhd0r3JClsVo5dxP9xpmS5-fbjtVmLmy39IiXED91itGt-EYMmpuxi2-uT5T6P-lohvFutACE9-utPn8JBxpwTIZaM7yMfWAA5ADmlQW_L5OpO2aYURTra2iSTX2gH-OB8CM3tdMdaqa3LPANX289Cjjocl-DOK4drdaI Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: eda6037b1d4b4d31b7a7ad298452cfbb Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:30:24.234087 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:30:24.235883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eda6037b1d4b4d31b7a7ad298452cfbb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:30:24.235883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:30:24.235883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: eda6037b1d4b4d31b7a7ad298452cfbb Oct 06 12:30:24.235883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:30:24.235883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-AttachVolumeShelveTestJSON-1479776453-project Oct 06 12:30:24.235883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:30:24.235883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:30:24.235883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: ff9c115c7083441c8b363e9b685ef110 Oct 06 12:30:24.235883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1479776453-project Oct 06 12:30:24.235883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:30:24.235883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. Oct 06 12:30:24.235883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '5b1825b8-e10c-4c5b-adf9-3456c97a68e2'} Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:30:24.236803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. Oct 06 12:30:24.238671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:30:24.240144 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b8ac4e33-403b-4363-acec-68e63fcf2b1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Returning 404 to user: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:30:24.246212 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b8ac4e33-403b-4363-acec-68e63fcf2b1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 404 len: 111 microversion: 2.20 time: 0.068860 Oct 06 12:30:24.246212 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 434/858] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:24 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:30:24.252411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a5d159de-5a17-49fa-8e0d-8964be4a980b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '.version_select at 0x7f03aa73eaf0>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:24.281561 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a5d159de-5a17-49fa-8e0d-8964be4a980b tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-133641512" status: 204 len: 0 microversion: 2.20 time: 0.034717 Oct 06 12:30:24.282226 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 425/859] 10.222.0.33 () {60 vars in 1259 bytes} [Thu Oct 6 12:30:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-133641512 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:30:24.383578 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-fc017ba6-8557-48d9-923d-66f0964be133 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Action: 'create', calling method: .version_select at 0x7f03ae2e1820>, body: {"keypair": {"name": "tempest-keypair-644240746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+v47xC4NRXYToB48QyIMMVB918AUeoN11L/7qrim2cQ4FEnISU7bMcikSmXnW9U5K5rTRNNVGmbnec3NWNc/w7JhbrVAwh6tkytsPd/1yIxwmKXs0K1RFfC23Y1ZTQVA=="}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:24.400815 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-fc017ba6-8557-48d9-923d-66f0964be133 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Getting quotas for project 828d3459cdd641d98772383edfe3268f. Resources: {'key_pairs'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:30:24.404705 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-fc017ba6-8557-48d9-923d-66f0964be133 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Getting quotas for user 3066c1c9c79942c289b733d886d9fd0f and project 828d3459cdd641d98772383edfe3268f. Resources: {'key_pairs'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:30:24.428871 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-fc017ba6-8557-48d9-923d-66f0964be133 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049203 Oct 06 12:30:24.429712 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 435/860] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 12:30:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:24.997151 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-65b5b267-91c2-48dc-8d75-0a3912e2e200 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Action: 'create', calling method: .version_select at 0x7f03ae20d280>, body: {"keypair": {"name": "tempest-keypair-1534206062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJxtg/eAYut/njeGEvP9eo5lMLXXIyGKhTAwyG6nW6sC60bIvLewf7x5GMISu09wn0SQl3KF3dUmasl288V52vDAq8mQgNRKcflaozPS1Netuf48Jbfes9lwSfvEptHAA=="}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:25.018054 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-65b5b267-91c2-48dc-8d75-0a3912e2e200 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Getting quotas for project eda6037b1d4b4d31b7a7ad298452cfbb. Resources: {'key_pairs'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:30:25.022228 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-65b5b267-91c2-48dc-8d75-0a3912e2e200 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Getting quotas for user ff9c115c7083441c8b363e9b685ef110 and project eda6037b1d4b4d31b7a7ad298452cfbb. Resources: {'key_pairs'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:30:25.044648 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-65b5b267-91c2-48dc-8d75-0a3912e2e200 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.054355 Oct 06 12:30:25.045577 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 426/861] 10.222.0.33 () {62 vars in 1200 bytes} [Thu Oct 6 12:30:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 06 12:30:25.110787 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f5142d38-e861-4a2e-943f-ea0bd1244236 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:25.111320 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f5142d38-e861-4a2e-943f-ea0bd1244236 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:25.117883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f5142d38-e861-4a2e-943f-ea0bd1244236 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:25.118638 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f5142d38-e861-4a2e-943f-ea0bd1244236 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:25.119082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f5142d38-e861-4a2e-943f-ea0bd1244236 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:25.119827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f5142d38-e861-4a2e-943f-ea0bd1244236 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:25.120287 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f5142d38-e861-4a2e-943f-ea0bd1244236 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:25.120717 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f5142d38-e861-4a2e-943f-ea0bd1244236 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:25.326238 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f5142d38-e861-4a2e-943f-ea0bd1244236 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:25.337577 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f5142d38-e861-4a2e-943f-ea0bd1244236 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.230731 Oct 06 12:30:25.358808 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 436/862] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:25 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:25.876920 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2047053375", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0805475d-8b9c-4baf-bd63-089b9f9df6f5"}], "security_groups": [{"name": "tempest-securitygroup--1509268081"}], "key_name": "tempest-keypair-644240746", "user_data": "}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:25.981417 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.network.neutron [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] validate_networks() for [('0805475d-8b9c-4baf-bd63-089b9f9df6f5', None, None, None, None, None)] {{(pid=120509) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:30:26.342899 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1234915287", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a983a2d0-c8c4-4203-b602-635e6e2680bd"}], "security_groups": [{"name": "tempest-securitygroup--884300434"}], "key_name": "tempest-keypair-1534206062", "user_data": "}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:26.360644 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Flavor limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:30:26.361161 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Image limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:30:26.361790 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Flavor pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:30:26.362195 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Image pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:30:26.362718 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:30:26.371260 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:26.371786 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:26.372213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:26.372950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:26.373398 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:26.373809 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:26.385397 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:26.393372 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Getting quotas for project 828d3459cdd641d98772383edfe3268f. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:30:26.398356 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Getting quotas for user 3066c1c9c79942c289b733d886d9fd0f and project 828d3459cdd641d98772383edfe3268f. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:30:26.410399 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Going to run 1 instances... {{(pid=120509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:30:26.412728 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:30:26.450068 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.network.neutron [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] validate_networks() for [('a983a2d0-c8c4-4203-b602-635e6e2680bd', None, None, None, None, None)] {{(pid=120508) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:30:26.461802 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-6fc350fd-24f7-46ba-97dd-2e6a4fc6ed4e tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.589255 Oct 06 12:30:26.462451 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 427/863] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:30:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:30:26.468869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-181a0cd7-999b-4bf2-a448-4d47b234d77e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:26.468869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-181a0cd7-999b-4bf2-a448-4d47b234d77e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:26.473444 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-181a0cd7-999b-4bf2-a448-4d47b234d77e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:26.473962 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-181a0cd7-999b-4bf2-a448-4d47b234d77e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:26.474367 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-181a0cd7-999b-4bf2-a448-4d47b234d77e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:26.475056 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-181a0cd7-999b-4bf2-a448-4d47b234d77e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:26.476130 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-181a0cd7-999b-4bf2-a448-4d47b234d77e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:26.476559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-181a0cd7-999b-4bf2-a448-4d47b234d77e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:26.685209 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-181a0cd7-999b-4bf2-a448-4d47b234d77e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:26.693367 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-181a0cd7-999b-4bf2-a448-4d47b234d77e tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.229932 Oct 06 12:30:26.693944 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 428/864] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:26 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:26.711636 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4a4cd4f4-51e1-4d72-9a72-4112b4fe2040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:26.712195 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4a4cd4f4-51e1-4d72-9a72-4112b4fe2040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:26.718586 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4a4cd4f4-51e1-4d72-9a72-4112b4fe2040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:26.719081 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4a4cd4f4-51e1-4d72-9a72-4112b4fe2040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:26.719493 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4a4cd4f4-51e1-4d72-9a72-4112b4fe2040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:26.720753 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4a4cd4f4-51e1-4d72-9a72-4112b4fe2040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:26.721365 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4a4cd4f4-51e1-4d72-9a72-4112b4fe2040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:26.721844 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4a4cd4f4-51e1-4d72-9a72-4112b4fe2040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:26.747710 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4a4cd4f4-51e1-4d72-9a72-4112b4fe2040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Going to try to terminate instance {{(pid=120509) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:30:26.835819 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4a4cd4f4-51e1-4d72-9a72-4112b4fe2040 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 204 len: 0 microversion: 2.1 time: 0.140083 Oct 06 12:30:26.837189 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 429/865] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:30:26 2022] DELETE /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:30:26.844717 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4adf2106-1702-4dd3-86bd-0ef99729b0f0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:26.845498 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4adf2106-1702-4dd3-86bd-0ef99729b0f0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:27.148327 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4adf2106-1702-4dd3-86bd-0ef99729b0f0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:27.157634 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4adf2106-1702-4dd3-86bd-0ef99729b0f0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1237 microversion: 2.1 time: 0.317638 Oct 06 12:30:27.159022 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 430/866] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:26 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1237 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:27.162861 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Flavor limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:30:27.163532 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Image limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:30:27.165037 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Flavor pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:30:27.165667 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Image pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:30:27.166299 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:30:27.173839 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-51dd94b5-8188-47fc-8774-c77e743026c2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:27.174457 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-51dd94b5-8188-47fc-8774-c77e743026c2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:27.175912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:27.176554 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:27.177089 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:27.178074 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:27.178634 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:27.179174 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:27.184772 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-51dd94b5-8188-47fc-8774-c77e743026c2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:27.185261 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-51dd94b5-8188-47fc-8774-c77e743026c2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:27.185954 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-51dd94b5-8188-47fc-8774-c77e743026c2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:27.186780 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-51dd94b5-8188-47fc-8774-c77e743026c2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:27.187116 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-51dd94b5-8188-47fc-8774-c77e743026c2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:27.187608 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-51dd94b5-8188-47fc-8774-c77e743026c2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:27.190616 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:27.202805 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Getting quotas for project eda6037b1d4b4d31b7a7ad298452cfbb. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:30:27.207602 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:27.208448 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Getting quotas for user ff9c115c7083441c8b363e9b685ef110 and project eda6037b1d4b4d31b7a7ad298452cfbb. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:30:27.221007 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Going to run 1 instances... {{(pid=120508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:30:27.223435 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:30:27.280838 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c57d0819-c6b1-493e-8f0c-f37e02d30434 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.942147 Oct 06 12:30:27.287682 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 437/867] 10.222.0.33 () {62 vars in 1188 bytes} [Thu Oct 6 12:30:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 06 12:30:27.296719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0282215e-2e85-4468-a896-db9e547a6687 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:27.297160 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-0282215e-2e85-4468-a896-db9e547a6687 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:27.376968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-0282215e-2e85-4468-a896-db9e547a6687 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:27.395701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-0282215e-2e85-4468-a896-db9e547a6687 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:27.397772 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-0282215e-2e85-4468-a896-db9e547a6687 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:27.399556 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-0282215e-2e85-4468-a896-db9e547a6687 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1282 microversion: 2.20 time: 0.110632 Oct 06 12:30:27.400197 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 438/868] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:27 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:27.404206 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-51dd94b5-8188-47fc-8774-c77e743026c2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:27.412864 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-51dd94b5-8188-47fc-8774-c77e743026c2 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1508 microversion: 2.1 time: 0.252830 Oct 06 12:30:27.413681 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 431/869] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:27 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1508 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:27.717696 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-70b96969-42d8-45bd-b314-2d989f20c48a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:27.718811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-70b96969-42d8-45bd-b314-2d989f20c48a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:27.727394 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70b96969-42d8-45bd-b314-2d989f20c48a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:27.728940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70b96969-42d8-45bd-b314-2d989f20c48a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:27.729606 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70b96969-42d8-45bd-b314-2d989f20c48a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:27.730687 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70b96969-42d8-45bd-b314-2d989f20c48a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:27.731381 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70b96969-42d8-45bd-b314-2d989f20c48a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:27.732204 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70b96969-42d8-45bd-b314-2d989f20c48a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:27.981680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-70b96969-42d8-45bd-b314-2d989f20c48a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:27.989500 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-70b96969-42d8-45bd-b314-2d989f20c48a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.275929 Oct 06 12:30:27.990079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 439/870] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:27 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:28.181956 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-71e381ab-5556-4e17-9020-54ae846acec0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:28.182561 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-71e381ab-5556-4e17-9020-54ae846acec0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:28.195458 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71e381ab-5556-4e17-9020-54ae846acec0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:28.196194 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71e381ab-5556-4e17-9020-54ae846acec0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:28.196639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71e381ab-5556-4e17-9020-54ae846acec0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:28.197398 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71e381ab-5556-4e17-9020-54ae846acec0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:28.197849 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71e381ab-5556-4e17-9020-54ae846acec0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:28.198274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71e381ab-5556-4e17-9020-54ae846acec0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:28.261028 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-6d40f034-e2a5-4ca8-9680-f5faa16248ec req-811c5615-1414-468e-ac92-83182b711b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ff3ab6-55a2-45ae-a912-59faf8868070", "name": "network-vif-deleted", "tag": "180aaafa-49f4-4890-afea-eb300c2b071f"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:28.271010 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-6d40f034-e2a5-4ca8-9680-f5faa16248ec req-811c5615-1414-468e-ac92-83182b711b68 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:28.271865 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-6d40f034-e2a5-4ca8-9680-f5faa16248ec req-811c5615-1414-468e-ac92-83182b711b68 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:28.272359 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-6d40f034-e2a5-4ca8-9680-f5faa16248ec req-811c5615-1414-468e-ac92-83182b711b68 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:28.280210 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-71e381ab-5556-4e17-9020-54ae846acec0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:28.284929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-6d40f034-e2a5-4ca8-9680-f5faa16248ec req-811c5615-1414-468e-ac92-83182b711b68 service nova] Creating event network-vif-deleted:180aaafa-49f4-4890-afea-eb300c2b071f for instance d1ff3ab6-55a2-45ae-a912-59faf8868070 on hv-cinder-85604 Oct 06 12:30:28.288406 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-71e381ab-5556-4e17-9020-54ae846acec0 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1289 microversion: 2.1 time: 0.110320 Oct 06 12:30:28.289150 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 432/871] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:28 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1289 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:28.290558 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-6d40f034-e2a5-4ca8-9680-f5faa16248ec req-811c5615-1414-468e-ac92-83182b711b68 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033342 Oct 06 12:30:28.291369 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 440/872] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:28.425141 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c9412554-4cd5-42c2-811d-b1e60b245032 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:28.425741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c9412554-4cd5-42c2-811d-b1e60b245032 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:28.432058 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c9412554-4cd5-42c2-811d-b1e60b245032 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:28.432781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c9412554-4cd5-42c2-811d-b1e60b245032 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:28.433363 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c9412554-4cd5-42c2-811d-b1e60b245032 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:28.434207 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c9412554-4cd5-42c2-811d-b1e60b245032 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:28.434665 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c9412554-4cd5-42c2-811d-b1e60b245032 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:28.435089 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c9412554-4cd5-42c2-811d-b1e60b245032 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:28.437268 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-86c72b8a-7cb8-425c-8bff-1cdbd352fa94 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:28.438675 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-86c72b8a-7cb8-425c-8bff-1cdbd352fa94 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:28.444769 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-86c72b8a-7cb8-425c-8bff-1cdbd352fa94 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:28.446127 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-86c72b8a-7cb8-425c-8bff-1cdbd352fa94 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:28.446576 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-86c72b8a-7cb8-425c-8bff-1cdbd352fa94 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:28.447319 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-86c72b8a-7cb8-425c-8bff-1cdbd352fa94 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:28.447883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-86c72b8a-7cb8-425c-8bff-1cdbd352fa94 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:28.448312 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-86c72b8a-7cb8-425c-8bff-1cdbd352fa94 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:28.491129 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-86c72b8a-7cb8-425c-8bff-1cdbd352fa94 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:28.491641 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-86c72b8a-7cb8-425c-8bff-1cdbd352fa94 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:28.492080 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-86c72b8a-7cb8-425c-8bff-1cdbd352fa94 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:28.492526 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-86c72b8a-7cb8-425c-8bff-1cdbd352fa94 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lazy-loading 'fault' on Instance uuid d1ff3ab6-55a2-45ae-a912-59faf8868070 {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:30:28.613948 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-86c72b8a-7cb8-425c-8bff-1cdbd352fa94 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:28.615020 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c9412554-4cd5-42c2-811d-b1e60b245032 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:28.624508 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c9412554-4cd5-42c2-811d-b1e60b245032 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:28.626062 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c9412554-4cd5-42c2-811d-b1e60b245032 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:28.627745 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c9412554-4cd5-42c2-811d-b1e60b245032 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1334 microversion: 2.20 time: 0.206635 Oct 06 12:30:28.628823 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 433/873] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:28 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1334 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:28.633530 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-86c72b8a-7cb8-425c-8bff-1cdbd352fa94 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1312 microversion: 2.1 time: 0.200515 Oct 06 12:30:28.652707 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 441/874] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:28 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1312 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:29.064964 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a3c5d11e-aba4-423d-94ef-ef6be0b36392 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:29.065650 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a3c5d11e-aba4-423d-94ef-ef6be0b36392 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:29.072172 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a3c5d11e-aba4-423d-94ef-ef6be0b36392 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:29.072736 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a3c5d11e-aba4-423d-94ef-ef6be0b36392 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:29.073245 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a3c5d11e-aba4-423d-94ef-ef6be0b36392 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:29.074007 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a3c5d11e-aba4-423d-94ef-ef6be0b36392 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:29.074553 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a3c5d11e-aba4-423d-94ef-ef6be0b36392 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:29.075051 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a3c5d11e-aba4-423d-94ef-ef6be0b36392 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:29.281638 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a3c5d11e-aba4-423d-94ef-ef6be0b36392 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:29.294234 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a3c5d11e-aba4-423d-94ef-ef6be0b36392 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.284449 Oct 06 12:30:29.295682 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 434/875] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:29 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:29.313207 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-35d67591-39d1-464e-b71d-707903dff3b2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:29.314129 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-35d67591-39d1-464e-b71d-707903dff3b2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:29.320479 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-35d67591-39d1-464e-b71d-707903dff3b2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:29.320972 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-35d67591-39d1-464e-b71d-707903dff3b2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:29.321444 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-35d67591-39d1-464e-b71d-707903dff3b2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:29.322335 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-35d67591-39d1-464e-b71d-707903dff3b2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:29.323093 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-35d67591-39d1-464e-b71d-707903dff3b2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:29.323772 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-35d67591-39d1-464e-b71d-707903dff3b2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:29.445201 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-35d67591-39d1-464e-b71d-707903dff3b2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:29.453748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-35d67591-39d1-464e-b71d-707903dff3b2 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1295 microversion: 2.1 time: 0.144531 Oct 06 12:30:29.470526 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 442/876] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:29 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1295 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:29.637277 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-270db733-fc30-4124-8ae5-32c3e32696bb req-8eaf48cc-0fd2-4bc5-8a16-62d804327e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094", "name": "network-vif-plugged", "status": "completed", "tag": "80e7b3d0-e904-4d2f-8247-bd9a538f244c"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:29.650540 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-270db733-fc30-4124-8ae5-32c3e32696bb req-8eaf48cc-0fd2-4bc5-8a16-62d804327e3f service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:29.652349 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-270db733-fc30-4124-8ae5-32c3e32696bb req-8eaf48cc-0fd2-4bc5-8a16-62d804327e3f service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:29.652949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-270db733-fc30-4124-8ae5-32c3e32696bb req-8eaf48cc-0fd2-4bc5-8a16-62d804327e3f service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:29.660652 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-bb84bc95-7280-48e6-8b87-cc7f12227535 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:29.661268 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-bb84bc95-7280-48e6-8b87-cc7f12227535 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:29.668419 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-270db733-fc30-4124-8ae5-32c3e32696bb req-8eaf48cc-0fd2-4bc5-8a16-62d804327e3f service nova] Creating event network-vif-plugged:80e7b3d0-e904-4d2f-8247-bd9a538f244c for instance 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 on hv-cinder-85604 Oct 06 12:30:29.670567 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bb84bc95-7280-48e6-8b87-cc7f12227535 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:29.671079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bb84bc95-7280-48e6-8b87-cc7f12227535 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:29.671523 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bb84bc95-7280-48e6-8b87-cc7f12227535 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:29.674526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-270db733-fc30-4124-8ae5-32c3e32696bb req-8eaf48cc-0fd2-4bc5-8a16-62d804327e3f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043506 Oct 06 12:30:29.674778 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bb84bc95-7280-48e6-8b87-cc7f12227535 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:29.675867 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 435/877] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:29.676755 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bb84bc95-7280-48e6-8b87-cc7f12227535 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:29.677214 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bb84bc95-7280-48e6-8b87-cc7f12227535 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:29.682785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0a9a250b-d0e8-4863-935c-82ef5a4f13c6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:29.683887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0a9a250b-d0e8-4863-935c-82ef5a4f13c6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:29.692684 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0a9a250b-d0e8-4863-935c-82ef5a4f13c6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:29.693540 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0a9a250b-d0e8-4863-935c-82ef5a4f13c6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:29.694134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0a9a250b-d0e8-4863-935c-82ef5a4f13c6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:29.695143 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0a9a250b-d0e8-4863-935c-82ef5a4f13c6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:29.696078 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0a9a250b-d0e8-4863-935c-82ef5a4f13c6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:29.696990 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0a9a250b-d0e8-4863-935c-82ef5a4f13c6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:29.747015 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0a9a250b-d0e8-4863-935c-82ef5a4f13c6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:29.747497 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0a9a250b-d0e8-4863-935c-82ef5a4f13c6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:29.747975 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0a9a250b-d0e8-4863-935c-82ef5a4f13c6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:29.748419 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-0a9a250b-d0e8-4863-935c-82ef5a4f13c6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lazy-loading 'fault' on Instance uuid d1ff3ab6-55a2-45ae-a912-59faf8868070 {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:30:29.831359 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-bb84bc95-7280-48e6-8b87-cc7f12227535 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:29.841101 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0a9a250b-d0e8-4863-935c-82ef5a4f13c6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:29.841836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-bb84bc95-7280-48e6-8b87-cc7f12227535 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:29.844487 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-bb84bc95-7280-48e6-8b87-cc7f12227535 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:29.846009 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-bb84bc95-7280-48e6-8b87-cc7f12227535 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1340 microversion: 2.20 time: 0.191014 Oct 06 12:30:29.846876 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 443/878] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:29 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1340 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:30:29.875746 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0a9a250b-d0e8-4863-935c-82ef5a4f13c6 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 200 len: 1312 microversion: 2.1 time: 0.197643 Oct 06 12:30:29.892383 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 436/879] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:29 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 1312 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:30.324584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2a1d12b7-4c3f-4436-9137-9d31250832d3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:30.326056 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2a1d12b7-4c3f-4436-9137-9d31250832d3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:30.352459 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2a1d12b7-4c3f-4436-9137-9d31250832d3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:30.356497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2a1d12b7-4c3f-4436-9137-9d31250832d3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:30.359459 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2a1d12b7-4c3f-4436-9137-9d31250832d3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:30.360481 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2a1d12b7-4c3f-4436-9137-9d31250832d3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:30.364057 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2a1d12b7-4c3f-4436-9137-9d31250832d3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:30.364614 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2a1d12b7-4c3f-4436-9137-9d31250832d3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:30.477615 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-10063cb3-1124-470a-809a-cccdf5b39539 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:30.478230 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-10063cb3-1124-470a-809a-cccdf5b39539 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:30.487039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-10063cb3-1124-470a-809a-cccdf5b39539 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:30.487792 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-10063cb3-1124-470a-809a-cccdf5b39539 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:30.488415 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-10063cb3-1124-470a-809a-cccdf5b39539 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:30.489290 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-10063cb3-1124-470a-809a-cccdf5b39539 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:30.496274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-10063cb3-1124-470a-809a-cccdf5b39539 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:30.496732 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-10063cb3-1124-470a-809a-cccdf5b39539 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:30.700350 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2a1d12b7-4c3f-4436-9137-9d31250832d3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:30.709618 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2a1d12b7-4c3f-4436-9137-9d31250832d3 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.390916 Oct 06 12:30:30.720801 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 444/880] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:30 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:30.766768 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-10063cb3-1124-470a-809a-cccdf5b39539 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:30.775485 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-10063cb3-1124-470a-809a-cccdf5b39539 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1363 microversion: 2.1 time: 0.301712 Oct 06 12:30:30.776392 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 437/881] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:30 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:30:30.874390 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6e1e6450-b994-45e3-8ebf-dadb8e4f1616 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:30.875257 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-6e1e6450-b994-45e3-8ebf-dadb8e4f1616 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:30.883568 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6e1e6450-b994-45e3-8ebf-dadb8e4f1616 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:30.884355 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6e1e6450-b994-45e3-8ebf-dadb8e4f1616 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:30.884819 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6e1e6450-b994-45e3-8ebf-dadb8e4f1616 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:30.885993 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6e1e6450-b994-45e3-8ebf-dadb8e4f1616 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:30.886464 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6e1e6450-b994-45e3-8ebf-dadb8e4f1616 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:30.887386 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6e1e6450-b994-45e3-8ebf-dadb8e4f1616 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:30.898334 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-88fa018f-55d0-41da-a7e0-d01bce2d8721 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:30.898933 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-88fa018f-55d0-41da-a7e0-d01bce2d8721 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: d1ff3ab6-55a2-45ae-a912-59faf8868070] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:30.910967 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88fa018f-55d0-41da-a7e0-d01bce2d8721 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:30.911788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88fa018f-55d0-41da-a7e0-d01bce2d8721 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:30.912378 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88fa018f-55d0-41da-a7e0-d01bce2d8721 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:30.913272 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88fa018f-55d0-41da-a7e0-d01bce2d8721 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:30.913717 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88fa018f-55d0-41da-a7e0-d01bce2d8721 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:30.914294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88fa018f-55d0-41da-a7e0-d01bce2d8721 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:30.929184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-88fa018f-55d0-41da-a7e0-d01bce2d8721 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] HTTP exception thrown: Instance d1ff3ab6-55a2-45ae-a912-59faf8868070 could not be found. Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-88fa018f-55d0-41da-a7e0-d01bce2d8721 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Request method failure captured: Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 HTTP/1.1 Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsh-PJ9xvBXdfQe_7UormM1Qyx0qepQqe1wI78PUDz3eEOb52qjqvlvg_d8nEkHrVtXCoBdXqhuEix6aY08jzJfIy6nrnz7MkzwZ2sOKibXZ2ZU4L1xUu_NrfA_ABN8p0EemOJk_E32lA71Qz_KuMtDmQk38cZgrdfRfT30A7Fp6Ci4 Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 9138bc89f5204975a18156097530643a Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-754252330 Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:30:30.931557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:30:30.933131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9138bc89f5204975a18156097530643a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9138bc89f5204975a18156097530643a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9138bc89f5204975a18156097530643a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9138bc89f5204975a18156097530643a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:30:30.933131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-ServerRescueNegativeTestJSON-754252330 Oct 06 12:30:30.933131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 9138bc89f5204975a18156097530643a Oct 06 12:30:30.933131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-754252330 Oct 06 12:30:30.933131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-ServerRescueNegativeTestJSON-754252330-project Oct 06 12:30:30.933131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:30:30.933131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:30:30.933131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 1f4cbe342b2c4378b3c0ab2f1cd55260 Oct 06 12:30:30.933131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-ServerRescueNegativeTestJSON-754252330-project Oct 06 12:30:30.933131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:30:30.933131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance d1ff3ab6-55a2-45ae-a912-59faf8868070 could not be found. Oct 06 12:30:30.933131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': 'd1ff3ab6-55a2-45ae-a912-59faf8868070'} Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1ff3ab6-55a2-45ae-a912-59faf8868070 could not be found. Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:30:30.934034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1ff3ab6-55a2-45ae-a912-59faf8868070 could not be found. Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1ff3ab6-55a2-45ae-a912-59faf8868070 could not be found. Oct 06 12:30:30.935370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:30.937279 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-88fa018f-55d0-41da-a7e0-d01bce2d8721 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Returning 404 to user: Instance d1ff3ab6-55a2-45ae-a912-59faf8868070 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:30:30.938120 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-88fa018f-55d0-41da-a7e0-d01bce2d8721 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070" status: 404 len: 111 microversion: 2.1 time: 0.043907 Oct 06 12:30:30.938844 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 438/882] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:30 2022] GET /compute/v2.1/servers/d1ff3ab6-55a2-45ae-a912-59faf8868070 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:30:30.948864 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d8a072bf-6388-4dac-a217-af61cc0130ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:30.949443 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d8a072bf-6388-4dac-a217-af61cc0130ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:30.955534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d8a072bf-6388-4dac-a217-af61cc0130ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:30.956125 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d8a072bf-6388-4dac-a217-af61cc0130ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:30.956671 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d8a072bf-6388-4dac-a217-af61cc0130ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:30.957442 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d8a072bf-6388-4dac-a217-af61cc0130ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:30.958500 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d8a072bf-6388-4dac-a217-af61cc0130ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:30.959001 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d8a072bf-6388-4dac-a217-af61cc0130ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:30.988982 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d8a072bf-6388-4dac-a217-af61cc0130ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Going to try to terminate instance {{(pid=120509) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:30:31.073904 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d8a072bf-6388-4dac-a217-af61cc0130ea tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 204 len: 0 microversion: 2.1 time: 0.128914 Oct 06 12:30:31.074587 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 439/883] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:30:30 2022] DELETE /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:30:31.083076 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-106ba546-a1c4-4023-85f1-05ff9d63d737 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:31.084081 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-106ba546-a1c4-4023-85f1-05ff9d63d737 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:31.095697 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-106ba546-a1c4-4023-85f1-05ff9d63d737 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:31.096445 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-106ba546-a1c4-4023-85f1-05ff9d63d737 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:31.097116 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-106ba546-a1c4-4023-85f1-05ff9d63d737 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:31.097864 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-106ba546-a1c4-4023-85f1-05ff9d63d737 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:31.098586 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-106ba546-a1c4-4023-85f1-05ff9d63d737 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:31.099019 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-106ba546-a1c4-4023-85f1-05ff9d63d737 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:31.113119 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6e1e6450-b994-45e3-8ebf-dadb8e4f1616 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:31.124543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6e1e6450-b994-45e3-8ebf-dadb8e4f1616 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:31.126356 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-6e1e6450-b994-45e3-8ebf-dadb8e4f1616 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:31.127712 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-6e1e6450-b994-45e3-8ebf-dadb8e4f1616 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.258043 Oct 06 12:30:31.129348 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 445/884] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:30 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:31.280440 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-51843175-e146-40e5-ba56-df95883bcb3a req-5ac10ca3-7a2e-4253-8bec-e9402d6c2238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c71fe8d-fb4e-4848-9b99-318ccbb0ba14", "tag": "abc2aa64-ae2d-47b6-9296-fa6c134455a2"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:31.292311 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-51843175-e146-40e5-ba56-df95883bcb3a req-5ac10ca3-7a2e-4253-8bec-e9402d6c2238 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:31.292808 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-51843175-e146-40e5-ba56-df95883bcb3a req-5ac10ca3-7a2e-4253-8bec-e9402d6c2238 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:31.293247 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-51843175-e146-40e5-ba56-df95883bcb3a req-5ac10ca3-7a2e-4253-8bec-e9402d6c2238 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:31.308421 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-51843175-e146-40e5-ba56-df95883bcb3a req-5ac10ca3-7a2e-4253-8bec-e9402d6c2238 service nova] Creating event network-changed:abc2aa64-ae2d-47b6-9296-fa6c134455a2 for instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 on hv-cinder-85604 Oct 06 12:30:31.313410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-51843175-e146-40e5-ba56-df95883bcb3a req-5ac10ca3-7a2e-4253-8bec-e9402d6c2238 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036555 Oct 06 12:30:31.314174 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 446/885] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:31.351544 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-106ba546-a1c4-4023-85f1-05ff9d63d737 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:31.362187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-106ba546-a1c4-4023-85f1-05ff9d63d737 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.283254 Oct 06 12:30:31.363182 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 440/886] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:31 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:30:31.410220 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-16cbbbda-02e0-4e26-acba-e86c339c54bf req-1d6e24c4-f362-45dc-8c09-5a47770448ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c743b80a-43e9-4dc1-a570-6873a5992f34", "tag": "fc7be519-3630-4616-ad76-14402cf4ad87"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:31.419691 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-16cbbbda-02e0-4e26-acba-e86c339c54bf req-1d6e24c4-f362-45dc-8c09-5a47770448ba service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:31.420194 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-16cbbbda-02e0-4e26-acba-e86c339c54bf req-1d6e24c4-f362-45dc-8c09-5a47770448ba service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:31.420609 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-16cbbbda-02e0-4e26-acba-e86c339c54bf req-1d6e24c4-f362-45dc-8c09-5a47770448ba service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:31.431221 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-16cbbbda-02e0-4e26-acba-e86c339c54bf req-1d6e24c4-f362-45dc-8c09-5a47770448ba service nova] Creating event network-changed:fc7be519-3630-4616-ad76-14402cf4ad87 for instance c743b80a-43e9-4dc1-a570-6873a5992f34 on hv-cinder-85604 Oct 06 12:30:31.436080 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-16cbbbda-02e0-4e26-acba-e86c339c54bf req-1d6e24c4-f362-45dc-8c09-5a47770448ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029910 Oct 06 12:30:31.437136 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 447/887] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:31.732305 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-91bcdad1-9dda-4a39-9fee-5c8ef30fef23 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:31.732823 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-91bcdad1-9dda-4a39-9fee-5c8ef30fef23 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:31.739354 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91bcdad1-9dda-4a39-9fee-5c8ef30fef23 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:31.739889 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91bcdad1-9dda-4a39-9fee-5c8ef30fef23 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:31.740414 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91bcdad1-9dda-4a39-9fee-5c8ef30fef23 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:31.741107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91bcdad1-9dda-4a39-9fee-5c8ef30fef23 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:31.741565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91bcdad1-9dda-4a39-9fee-5c8ef30fef23 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:31.741980 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-91bcdad1-9dda-4a39-9fee-5c8ef30fef23 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:31.799638 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-02e8faa8-e4dc-4877-8d70-c02ec49cc422 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:31.800344 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-02e8faa8-e4dc-4877-8d70-c02ec49cc422 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:31.806709 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-02e8faa8-e4dc-4877-8d70-c02ec49cc422 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:31.807971 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-02e8faa8-e4dc-4877-8d70-c02ec49cc422 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:31.808611 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-02e8faa8-e4dc-4877-8d70-c02ec49cc422 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:31.809615 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-02e8faa8-e4dc-4877-8d70-c02ec49cc422 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:31.810250 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-02e8faa8-e4dc-4877-8d70-c02ec49cc422 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:31.810753 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-02e8faa8-e4dc-4877-8d70-c02ec49cc422 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:31.904956 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-91bcdad1-9dda-4a39-9fee-5c8ef30fef23 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:31.912594 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-91bcdad1-9dda-4a39-9fee-5c8ef30fef23 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1266 microversion: 2.1 time: 0.184180 Oct 06 12:30:31.913169 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 441/888] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:31 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:31.963275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-02e8faa8-e4dc-4877-8d70-c02ec49cc422 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:31.972047 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-02e8faa8-e4dc-4877-8d70-c02ec49cc422 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1363 microversion: 2.1 time: 0.177060 Oct 06 12:30:31.972814 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 448/889] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:31 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:30:32.153305 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-340e57f7-f253-4746-b59f-e75800a54656 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:32.153908 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-340e57f7-f253-4746-b59f-e75800a54656 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:32.159971 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-340e57f7-f253-4746-b59f-e75800a54656 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:32.160457 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-340e57f7-f253-4746-b59f-e75800a54656 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:32.160927 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-340e57f7-f253-4746-b59f-e75800a54656 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:32.161621 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-340e57f7-f253-4746-b59f-e75800a54656 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:32.162075 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-340e57f7-f253-4746-b59f-e75800a54656 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:32.162509 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-340e57f7-f253-4746-b59f-e75800a54656 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:32.292700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-340e57f7-f253-4746-b59f-e75800a54656 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:32.301031 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-340e57f7-f253-4746-b59f-e75800a54656 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:32.302547 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-340e57f7-f253-4746-b59f-e75800a54656 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:32.303664 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-340e57f7-f253-4746-b59f-e75800a54656 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.154860 Oct 06 12:30:32.304212 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 442/890] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:32 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:32.386135 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a32bee8b-3274-4ce3-ace4-24e7c079084b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:32.386747 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a32bee8b-3274-4ce3-ace4-24e7c079084b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:32.392688 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a32bee8b-3274-4ce3-ace4-24e7c079084b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:32.393174 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a32bee8b-3274-4ce3-ace4-24e7c079084b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:32.393610 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a32bee8b-3274-4ce3-ace4-24e7c079084b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:32.394293 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a32bee8b-3274-4ce3-ace4-24e7c079084b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:32.394752 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a32bee8b-3274-4ce3-ace4-24e7c079084b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:32.395177 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a32bee8b-3274-4ce3-ace4-24e7c079084b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:32.520609 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a32bee8b-3274-4ce3-ace4-24e7c079084b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:32.529033 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a32bee8b-3274-4ce3-ace4-24e7c079084b tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1521 microversion: 2.1 time: 0.146799 Oct 06 12:30:32.529604 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 449/891] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:32 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:32.937552 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9833a696-ce9d-41d6-b974-3258f1d50df5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:32.939576 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9833a696-ce9d-41d6-b974-3258f1d50df5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:32.946945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9833a696-ce9d-41d6-b974-3258f1d50df5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:32.948304 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9833a696-ce9d-41d6-b974-3258f1d50df5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:32.948843 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9833a696-ce9d-41d6-b974-3258f1d50df5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:32.949843 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9833a696-ce9d-41d6-b974-3258f1d50df5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:32.950385 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9833a696-ce9d-41d6-b974-3258f1d50df5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:32.950899 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9833a696-ce9d-41d6-b974-3258f1d50df5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:32.995889 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-cf2cd1af-5476-4353-b65d-9de0736706b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:32.996746 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-cf2cd1af-5476-4353-b65d-9de0736706b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:33.004421 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cf2cd1af-5476-4353-b65d-9de0736706b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:33.005088 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cf2cd1af-5476-4353-b65d-9de0736706b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:33.006052 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cf2cd1af-5476-4353-b65d-9de0736706b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:33.006889 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cf2cd1af-5476-4353-b65d-9de0736706b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:33.007427 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cf2cd1af-5476-4353-b65d-9de0736706b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:33.008940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cf2cd1af-5476-4353-b65d-9de0736706b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:33.404889 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9833a696-ce9d-41d6-b974-3258f1d50df5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:33.412515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-cf2cd1af-5476-4353-b65d-9de0736706b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:33.412862 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9833a696-ce9d-41d6-b974-3258f1d50df5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1452 microversion: 2.1 time: 0.481010 Oct 06 12:30:33.413766 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 443/892] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:32 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1452 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:33.418598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ec25e863-b042-4be1-baf3-fb8e255bf003 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:33.419208 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ec25e863-b042-4be1-baf3-fb8e255bf003 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:33.423003 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-cf2cd1af-5476-4353-b65d-9de0736706b6 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1363 microversion: 2.1 time: 0.432099 Oct 06 12:30:33.423804 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 450/893] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:32 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1363 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:30:33.429429 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec25e863-b042-4be1-baf3-fb8e255bf003 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:33.430128 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec25e863-b042-4be1-baf3-fb8e255bf003 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:33.430720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec25e863-b042-4be1-baf3-fb8e255bf003 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:33.432888 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec25e863-b042-4be1-baf3-fb8e255bf003 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:33.433558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec25e863-b042-4be1-baf3-fb8e255bf003 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:33.434153 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ec25e863-b042-4be1-baf3-fb8e255bf003 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:33.443262 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-388e13c4-1c33-46fc-8396-2ea3d729fd1c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:33.443946 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-388e13c4-1c33-46fc-8396-2ea3d729fd1c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:33.450531 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-388e13c4-1c33-46fc-8396-2ea3d729fd1c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:33.450956 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-388e13c4-1c33-46fc-8396-2ea3d729fd1c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:33.451404 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-388e13c4-1c33-46fc-8396-2ea3d729fd1c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:33.452149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-388e13c4-1c33-46fc-8396-2ea3d729fd1c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:33.452614 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-388e13c4-1c33-46fc-8396-2ea3d729fd1c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:33.453047 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-388e13c4-1c33-46fc-8396-2ea3d729fd1c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:33.715891 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-388e13c4-1c33-46fc-8396-2ea3d729fd1c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:33.723694 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-388e13c4-1c33-46fc-8396-2ea3d729fd1c tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1452 microversion: 2.1 time: 0.290031 Oct 06 12:30:33.724358 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 451/894] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:33 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1452 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:30:33.729374 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-32bc3c0d-6cd9-4171-ac02-3e850dc792ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:33.729980 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-32bc3c0d-6cd9-4171-ac02-3e850dc792ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:33.735354 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ec25e863-b042-4be1-baf3-fb8e255bf003 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:33.735978 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32bc3c0d-6cd9-4171-ac02-3e850dc792ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:33.736572 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32bc3c0d-6cd9-4171-ac02-3e850dc792ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:33.737100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32bc3c0d-6cd9-4171-ac02-3e850dc792ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:33.737902 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32bc3c0d-6cd9-4171-ac02-3e850dc792ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:33.739542 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32bc3c0d-6cd9-4171-ac02-3e850dc792ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:33.739542 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32bc3c0d-6cd9-4171-ac02-3e850dc792ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:33.758320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ec25e863-b042-4be1-baf3-fb8e255bf003 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:33.759816 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ec25e863-b042-4be1-baf3-fb8e255bf003 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:33.760984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ec25e863-b042-4be1-baf3-fb8e255bf003 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.346251 Oct 06 12:30:33.762136 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 444/895] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:33 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:33.810327 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-5190f091-23d9-4c37-9ccc-2db9305dfad1 req-403a0aee-6e1f-45cf-ab41-696994bef579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bdd2944-b97f-40e0-a1cb-915cea031265", "name": "network-vif-deleted", "tag": "9e7b0b39-c340-4a59-8b3a-a243b300266f"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:33.819969 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-5190f091-23d9-4c37-9ccc-2db9305dfad1 req-403a0aee-6e1f-45cf-ab41-696994bef579 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:33.820461 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-5190f091-23d9-4c37-9ccc-2db9305dfad1 req-403a0aee-6e1f-45cf-ab41-696994bef579 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:33.820895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-5190f091-23d9-4c37-9ccc-2db9305dfad1 req-403a0aee-6e1f-45cf-ab41-696994bef579 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:33.832273 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-5190f091-23d9-4c37-9ccc-2db9305dfad1 req-403a0aee-6e1f-45cf-ab41-696994bef579 service nova] Creating event network-vif-deleted:9e7b0b39-c340-4a59-8b3a-a243b300266f for instance 6bdd2944-b97f-40e0-a1cb-915cea031265 on hv-cinder-85604 Oct 06 12:30:33.837650 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-5190f091-23d9-4c37-9ccc-2db9305dfad1 req-403a0aee-6e1f-45cf-ab41-696994bef579 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031503 Oct 06 12:30:33.837981 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-32bc3c0d-6cd9-4171-ac02-3e850dc792ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:33.838735 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 445/896] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:33.845726 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-32bc3c0d-6cd9-4171-ac02-3e850dc792ac tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1479 microversion: 2.1 time: 0.120387 Oct 06 12:30:33.846295 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 452/897] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:33 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1479 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:34.450850 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4da71a42-3415-414f-82bb-d44bbe1bb105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:34.451608 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4da71a42-3415-414f-82bb-d44bbe1bb105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:34.457697 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4da71a42-3415-414f-82bb-d44bbe1bb105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:34.458177 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4da71a42-3415-414f-82bb-d44bbe1bb105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:34.458607 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4da71a42-3415-414f-82bb-d44bbe1bb105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:34.459361 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4da71a42-3415-414f-82bb-d44bbe1bb105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:34.459874 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4da71a42-3415-414f-82bb-d44bbe1bb105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:34.460298 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4da71a42-3415-414f-82bb-d44bbe1bb105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:34.592344 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4da71a42-3415-414f-82bb-d44bbe1bb105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:34.600079 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4da71a42-3415-414f-82bb-d44bbe1bb105 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1363 microversion: 2.1 time: 0.154478 Oct 06 12:30:34.600655 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 446/898] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:34 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:34.786180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-86d66fd4-dfb4-4642-b4a0-1f43177c3a27 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:34.786723 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-86d66fd4-dfb4-4642-b4a0-1f43177c3a27 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:34.793275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-86d66fd4-dfb4-4642-b4a0-1f43177c3a27 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:34.793756 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-86d66fd4-dfb4-4642-b4a0-1f43177c3a27 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:34.794193 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-86d66fd4-dfb4-4642-b4a0-1f43177c3a27 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:34.794892 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-86d66fd4-dfb4-4642-b4a0-1f43177c3a27 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:34.795361 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-86d66fd4-dfb4-4642-b4a0-1f43177c3a27 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:34.795867 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-86d66fd4-dfb4-4642-b4a0-1f43177c3a27 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:34.870007 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-749d2118-8e9d-41d5-93aa-2ba232528957 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:34.870874 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-749d2118-8e9d-41d5-93aa-2ba232528957 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:34.877212 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-749d2118-8e9d-41d5-93aa-2ba232528957 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:34.878136 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-749d2118-8e9d-41d5-93aa-2ba232528957 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:34.879370 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-749d2118-8e9d-41d5-93aa-2ba232528957 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:34.880180 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-749d2118-8e9d-41d5-93aa-2ba232528957 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:34.880730 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-749d2118-8e9d-41d5-93aa-2ba232528957 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:34.881243 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-749d2118-8e9d-41d5-93aa-2ba232528957 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:34.960973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-749d2118-8e9d-41d5-93aa-2ba232528957 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:34.968110 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-86d66fd4-dfb4-4642-b4a0-1f43177c3a27 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:34.970921 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-749d2118-8e9d-41d5-93aa-2ba232528957 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1479 microversion: 2.1 time: 0.105161 Oct 06 12:30:34.978987 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-86d66fd4-dfb4-4642-b4a0-1f43177c3a27 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:34.981079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-86d66fd4-dfb4-4642-b4a0-1f43177c3a27 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:34.982559 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-86d66fd4-dfb4-4642-b4a0-1f43177c3a27 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.200474 Oct 06 12:30:34.983376 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 453/899] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:34 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:34.983924 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 447/900] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:34 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1479 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:30:35.350731 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-c6518a4b-e787-4f3c-a4bd-fb69fe8844a4 req-862bd87c-a593-45c3-bd92-c0674d394de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094", "tag": "80e7b3d0-e904-4d2f-8247-bd9a538f244c"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:35.360424 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-c6518a4b-e787-4f3c-a4bd-fb69fe8844a4 req-862bd87c-a593-45c3-bd92-c0674d394de0 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:35.361001 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-c6518a4b-e787-4f3c-a4bd-fb69fe8844a4 req-862bd87c-a593-45c3-bd92-c0674d394de0 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:35.361490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-c6518a4b-e787-4f3c-a4bd-fb69fe8844a4 req-862bd87c-a593-45c3-bd92-c0674d394de0 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:35.525718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-c6518a4b-e787-4f3c-a4bd-fb69fe8844a4 req-862bd87c-a593-45c3-bd92-c0674d394de0 service nova] Creating event network-changed:80e7b3d0-e904-4d2f-8247-bd9a538f244c for instance 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 on hv-cinder-85604 Oct 06 12:30:35.530532 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-c6518a4b-e787-4f3c-a4bd-fb69fe8844a4 req-862bd87c-a593-45c3-bd92-c0674d394de0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183408 Oct 06 12:30:35.531441 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 454/901] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:35.623190 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7d169e9c-5bb5-4b1f-b692-26f43ffff5b1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:35.624068 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7d169e9c-5bb5-4b1f-b692-26f43ffff5b1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:35.630726 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d169e9c-5bb5-4b1f-b692-26f43ffff5b1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:35.631328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d169e9c-5bb5-4b1f-b692-26f43ffff5b1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:35.632033 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d169e9c-5bb5-4b1f-b692-26f43ffff5b1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:35.632949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d169e9c-5bb5-4b1f-b692-26f43ffff5b1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:35.633615 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d169e9c-5bb5-4b1f-b692-26f43ffff5b1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:35.634250 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d169e9c-5bb5-4b1f-b692-26f43ffff5b1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:35.639763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:35.996781 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-17357614-080c-4c50-8b92-268a2160a118 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:35.998741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-17357614-080c-4c50-8b92-268a2160a118 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:36.030398 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17357614-080c-4c50-8b92-268a2160a118 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:36.032623 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17357614-080c-4c50-8b92-268a2160a118 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:36.034511 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17357614-080c-4c50-8b92-268a2160a118 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:36.037740 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17357614-080c-4c50-8b92-268a2160a118 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:36.040002 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17357614-080c-4c50-8b92-268a2160a118 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:36.043719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17357614-080c-4c50-8b92-268a2160a118 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:36.052570 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7d169e9c-5bb5-4b1f-b692-26f43ffff5b1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:36.061031 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7d169e9c-5bb5-4b1f-b692-26f43ffff5b1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1363 microversion: 2.1 time: 0.442157 Oct 06 12:30:36.065666 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 448/902] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:35 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1363 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:36.077219 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3629d91f-68f0-452b-9e66-4ea3cce63081 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:36.081074 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3629d91f-68f0-452b-9e66-4ea3cce63081 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:36.095245 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3629d91f-68f0-452b-9e66-4ea3cce63081 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:36.096002 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3629d91f-68f0-452b-9e66-4ea3cce63081 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:36.096441 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3629d91f-68f0-452b-9e66-4ea3cce63081 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:36.097151 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3629d91f-68f0-452b-9e66-4ea3cce63081 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:36.097609 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3629d91f-68f0-452b-9e66-4ea3cce63081 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:36.098032 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3629d91f-68f0-452b-9e66-4ea3cce63081 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:36.136325 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17357614-080c-4c50-8b92-268a2160a118 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:36.137028 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17357614-080c-4c50-8b92-268a2160a118 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:36.137883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-17357614-080c-4c50-8b92-268a2160a118 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:36.138484 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-17357614-080c-4c50-8b92-268a2160a118 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lazy-loading 'fault' on Instance uuid 6bdd2944-b97f-40e0-a1cb-915cea031265 {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:30:36.235401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-17357614-080c-4c50-8b92-268a2160a118 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4cbe342b2c4378b3c0ab2f1cd55260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138bc89f5204975a18156097530643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:36.247722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-17357614-080c-4c50-8b92-268a2160a118 tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 200 len: 1311 microversion: 2.1 time: 0.257194 Oct 06 12:30:36.248242 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 455/903] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:35 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 1311 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:36.324810 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3629d91f-68f0-452b-9e66-4ea3cce63081 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:36.333071 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3629d91f-68f0-452b-9e66-4ea3cce63081 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:36.334522 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3629d91f-68f0-452b-9e66-4ea3cce63081 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:36.335642 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3629d91f-68f0-452b-9e66-4ea3cce63081 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.268784 Oct 06 12:30:36.336409 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 449/904] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:36 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:37.088941 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ed6780c2-70c1-49af-a9fd-f082b57d3b9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:37.089572 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ed6780c2-70c1-49af-a9fd-f082b57d3b9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:37.096129 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed6780c2-70c1-49af-a9fd-f082b57d3b9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:37.096682 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed6780c2-70c1-49af-a9fd-f082b57d3b9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:37.097122 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed6780c2-70c1-49af-a9fd-f082b57d3b9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:37.097847 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed6780c2-70c1-49af-a9fd-f082b57d3b9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:37.098333 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed6780c2-70c1-49af-a9fd-f082b57d3b9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:37.098762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed6780c2-70c1-49af-a9fd-f082b57d3b9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:37.191093 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:37.226045 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ed6780c2-70c1-49af-a9fd-f082b57d3b9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:37.234115 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ed6780c2-70c1-49af-a9fd-f082b57d3b9c tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1363 microversion: 2.1 time: 0.149995 Oct 06 12:30:37.234668 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 456/905] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:37 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:37.271423 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0f4e995c-02aa-47b7-b81e-c9be5c7e0d6a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:37.272072 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0f4e995c-02aa-47b7-b81e-c9be5c7e0d6a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] [instance: 6bdd2944-b97f-40e0-a1cb-915cea031265] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:37.273939 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:37.275797 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=12 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:37.281408 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0f4e995c-02aa-47b7-b81e-c9be5c7e0d6a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:37.281896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0f4e995c-02aa-47b7-b81e-c9be5c7e0d6a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:37.282536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0f4e995c-02aa-47b7-b81e-c9be5c7e0d6a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:37.283023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0f4e995c-02aa-47b7-b81e-c9be5c7e0d6a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:37.283478 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0f4e995c-02aa-47b7-b81e-c9be5c7e0d6a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:37.284115 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0f4e995c-02aa-47b7-b81e-c9be5c7e0d6a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:37.300787 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-0f4e995c-02aa-47b7-b81e-c9be5c7e0d6a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] HTTP exception thrown: Instance 6bdd2944-b97f-40e0-a1cb-915cea031265 could not be found. Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0f4e995c-02aa-47b7-b81e-c9be5c7e0d6a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Request method failure captured: Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 HTTP/1.1 Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsh-PJ9xvBXdfQe_7UormM1Qyx0qepQqe1wI78PUDz3eEOb52qjqvlvg_d8nEkHrVtXCoBdXqhuEix6aY08jzJfIy6nrnz7MkzwZ2sOKibXZ2ZU4L1xUu_NrfA_ABN8p0EemOJk_E32lA71Qz_KuMtDmQk38cZgrdfRfT30A7Fp6Ci4 Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 9138bc89f5204975a18156097530643a Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-754252330 Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:30:37.303328 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:30:37.304910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9138bc89f5204975a18156097530643a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9138bc89f5204975a18156097530643a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9138bc89f5204975a18156097530643a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9138bc89f5204975a18156097530643a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:30:37.304910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-ServerRescueNegativeTestJSON-754252330 Oct 06 12:30:37.304910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 9138bc89f5204975a18156097530643a Oct 06 12:30:37.304910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-754252330 Oct 06 12:30:37.304910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-ServerRescueNegativeTestJSON-754252330-project Oct 06 12:30:37.304910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:30:37.304910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:30:37.304910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 1f4cbe342b2c4378b3c0ab2f1cd55260 Oct 06 12:30:37.304910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-ServerRescueNegativeTestJSON-754252330-project Oct 06 12:30:37.304910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:30:37.304910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 6bdd2944-b97f-40e0-a1cb-915cea031265 could not be found. Oct 06 12:30:37.304910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '6bdd2944-b97f-40e0-a1cb-915cea031265'} Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bdd2944-b97f-40e0-a1cb-915cea031265 could not be found. Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:30:37.305701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bdd2944-b97f-40e0-a1cb-915cea031265 could not be found. Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bdd2944-b97f-40e0-a1cb-915cea031265 could not be found. Oct 06 12:30:37.307121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:37.308697 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0f4e995c-02aa-47b7-b81e-c9be5c7e0d6a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] Returning 404 to user: Instance 6bdd2944-b97f-40e0-a1cb-915cea031265 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:30:37.308697 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0f4e995c-02aa-47b7-b81e-c9be5c7e0d6a tempest-ServerRescueNegativeTestJSON-754252330 tempest-ServerRescueNegativeTestJSON-754252330-project] 10.222.0.33 "GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265" status: 404 len: 111 microversion: 2.1 time: 0.038081 Oct 06 12:30:37.308697 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 450/906] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:37 2022] GET /compute/v2.1/servers/6bdd2944-b97f-40e0-a1cb-915cea031265 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:30:37.364347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e5027722-0cea-41d1-a1d1-525f7876893f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:37.365439 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e5027722-0cea-41d1-a1d1-525f7876893f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:37.371624 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e5027722-0cea-41d1-a1d1-525f7876893f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:37.372128 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e5027722-0cea-41d1-a1d1-525f7876893f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:37.372644 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e5027722-0cea-41d1-a1d1-525f7876893f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:37.373362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e5027722-0cea-41d1-a1d1-525f7876893f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:37.373825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e5027722-0cea-41d1-a1d1-525f7876893f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:37.374255 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e5027722-0cea-41d1-a1d1-525f7876893f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:37.389946 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=12 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:37.394414 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=100 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:37.526679 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e5027722-0cea-41d1-a1d1-525f7876893f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:37.535114 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e5027722-0cea-41d1-a1d1-525f7876893f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:37.536680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e5027722-0cea-41d1-a1d1-525f7876893f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:37.537866 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e5027722-0cea-41d1-a1d1-525f7876893f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.177371 Oct 06 12:30:37.538635 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 457/907] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:37 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:38.258246 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-04fa4f4a-50e0-40f2-9d1a-02bc157f392a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:38.258862 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-04fa4f4a-50e0-40f2-9d1a-02bc157f392a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:38.264787 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-04fa4f4a-50e0-40f2-9d1a-02bc157f392a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:38.265276 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-04fa4f4a-50e0-40f2-9d1a-02bc157f392a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:38.265721 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-04fa4f4a-50e0-40f2-9d1a-02bc157f392a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:38.266413 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-04fa4f4a-50e0-40f2-9d1a-02bc157f392a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:38.266872 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-04fa4f4a-50e0-40f2-9d1a-02bc157f392a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:38.267300 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-04fa4f4a-50e0-40f2-9d1a-02bc157f392a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:38.397543 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-04fa4f4a-50e0-40f2-9d1a-02bc157f392a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:38.405670 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-04fa4f4a-50e0-40f2-9d1a-02bc157f392a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1363 microversion: 2.1 time: 0.151660 Oct 06 12:30:38.406520 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 451/908] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:38 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:38.562303 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-70c76989-6e37-4354-ad1f-c6ee86e89114 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:38.562917 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-70c76989-6e37-4354-ad1f-c6ee86e89114 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:38.569572 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70c76989-6e37-4354-ad1f-c6ee86e89114 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:38.570300 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70c76989-6e37-4354-ad1f-c6ee86e89114 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:38.570888 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70c76989-6e37-4354-ad1f-c6ee86e89114 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:38.571789 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70c76989-6e37-4354-ad1f-c6ee86e89114 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:38.572449 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70c76989-6e37-4354-ad1f-c6ee86e89114 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:38.573036 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70c76989-6e37-4354-ad1f-c6ee86e89114 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:38.710551 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-70c76989-6e37-4354-ad1f-c6ee86e89114 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:38.719992 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-70c76989-6e37-4354-ad1f-c6ee86e89114 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:38.721459 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-70c76989-6e37-4354-ad1f-c6ee86e89114 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:38.722597 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-70c76989-6e37-4354-ad1f-c6ee86e89114 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.164112 Oct 06 12:30:38.723174 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 458/909] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:38 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:39.433054 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-db272e8f-ca8f-4b34-b4e1-6cc3ecf396ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:39.433995 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-db272e8f-ca8f-4b34-b4e1-6cc3ecf396ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:39.441565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db272e8f-ca8f-4b34-b4e1-6cc3ecf396ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:39.442263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db272e8f-ca8f-4b34-b4e1-6cc3ecf396ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:39.442908 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db272e8f-ca8f-4b34-b4e1-6cc3ecf396ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:39.443976 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db272e8f-ca8f-4b34-b4e1-6cc3ecf396ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:39.444587 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db272e8f-ca8f-4b34-b4e1-6cc3ecf396ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:39.445163 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db272e8f-ca8f-4b34-b4e1-6cc3ecf396ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:39.464487 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-ef7e05cd-1098-45e8-97ce-ee3d8da8ea3c req-eb22299c-7cd3-4de1-9614-9e7a1dfae3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c71fe8d-fb4e-4848-9b99-318ccbb0ba14", "name": "network-vif-plugged", "status": "completed", "tag": "abc2aa64-ae2d-47b6-9296-fa6c134455a2"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:39.483896 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-ef7e05cd-1098-45e8-97ce-ee3d8da8ea3c req-eb22299c-7cd3-4de1-9614-9e7a1dfae3e3 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:39.484427 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-ef7e05cd-1098-45e8-97ce-ee3d8da8ea3c req-eb22299c-7cd3-4de1-9614-9e7a1dfae3e3 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:39.484874 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-ef7e05cd-1098-45e8-97ce-ee3d8da8ea3c req-eb22299c-7cd3-4de1-9614-9e7a1dfae3e3 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:39.505488 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-ef7e05cd-1098-45e8-97ce-ee3d8da8ea3c req-eb22299c-7cd3-4de1-9614-9e7a1dfae3e3 service nova] Creating event network-vif-plugged:abc2aa64-ae2d-47b6-9296-fa6c134455a2 for instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 on hv-cinder-85604 Oct 06 12:30:39.510704 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-ef7e05cd-1098-45e8-97ce-ee3d8da8ea3c req-eb22299c-7cd3-4de1-9614-9e7a1dfae3e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050663 Oct 06 12:30:39.511652 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 459/910] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:39.635635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-db272e8f-ca8f-4b34-b4e1-6cc3ecf396ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:39.645156 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-db272e8f-ca8f-4b34-b4e1-6cc3ecf396ee tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1363 microversion: 2.1 time: 0.217026 Oct 06 12:30:39.646531 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 452/911] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:39 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:39.753496 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8a226081-e5d5-4d02-970b-f8a59fd1b7a0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:39.754382 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8a226081-e5d5-4d02-970b-f8a59fd1b7a0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:39.763973 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a226081-e5d5-4d02-970b-f8a59fd1b7a0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:39.764829 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a226081-e5d5-4d02-970b-f8a59fd1b7a0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:39.765277 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a226081-e5d5-4d02-970b-f8a59fd1b7a0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:39.765998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a226081-e5d5-4d02-970b-f8a59fd1b7a0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:39.766624 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a226081-e5d5-4d02-970b-f8a59fd1b7a0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:39.767282 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a226081-e5d5-4d02-970b-f8a59fd1b7a0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:39.934699 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8a226081-e5d5-4d02-970b-f8a59fd1b7a0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:39.943015 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8a226081-e5d5-4d02-970b-f8a59fd1b7a0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:39.944571 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8a226081-e5d5-4d02-970b-f8a59fd1b7a0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:39.945770 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8a226081-e5d5-4d02-970b-f8a59fd1b7a0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.201534 Oct 06 12:30:39.946400 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 460/912] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:39 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:30:40.669704 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-fc9177a9-4b36-4fac-abb6-e00850e387e1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:40.670430 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-fc9177a9-4b36-4fac-abb6-e00850e387e1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:40.677400 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fc9177a9-4b36-4fac-abb6-e00850e387e1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:40.677883 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fc9177a9-4b36-4fac-abb6-e00850e387e1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:40.678322 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fc9177a9-4b36-4fac-abb6-e00850e387e1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:40.679012 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fc9177a9-4b36-4fac-abb6-e00850e387e1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:40.679459 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fc9177a9-4b36-4fac-abb6-e00850e387e1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:40.679909 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fc9177a9-4b36-4fac-abb6-e00850e387e1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:40.823689 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fc9177a9-4b36-4fac-abb6-e00850e387e1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:40.832096 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-fc9177a9-4b36-4fac-abb6-e00850e387e1 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1363 microversion: 2.1 time: 0.166786 Oct 06 12:30:40.833097 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 453/913] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:40 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:40.970288 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-77f3db34-fea5-44df-8a89-ae6d933e3de1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:40.970880 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-77f3db34-fea5-44df-8a89-ae6d933e3de1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:40.979245 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77f3db34-fea5-44df-8a89-ae6d933e3de1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:40.979774 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77f3db34-fea5-44df-8a89-ae6d933e3de1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:40.980437 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77f3db34-fea5-44df-8a89-ae6d933e3de1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:40.981144 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77f3db34-fea5-44df-8a89-ae6d933e3de1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:40.981786 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77f3db34-fea5-44df-8a89-ae6d933e3de1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:40.982338 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77f3db34-fea5-44df-8a89-ae6d933e3de1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:41.140621 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-77f3db34-fea5-44df-8a89-ae6d933e3de1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:41.150707 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-77f3db34-fea5-44df-8a89-ae6d933e3de1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:41.152452 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-77f3db34-fea5-44df-8a89-ae6d933e3de1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:41.153845 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-77f3db34-fea5-44df-8a89-ae6d933e3de1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.187489 Oct 06 12:30:41.154907 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 461/914] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:40 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:41.855200 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e817af7a-8d7a-4273-aa29-159049b66b3b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:41.855985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e817af7a-8d7a-4273-aa29-159049b66b3b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:41.862390 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e817af7a-8d7a-4273-aa29-159049b66b3b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:41.862877 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e817af7a-8d7a-4273-aa29-159049b66b3b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:41.863304 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e817af7a-8d7a-4273-aa29-159049b66b3b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:41.864017 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e817af7a-8d7a-4273-aa29-159049b66b3b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:41.864524 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e817af7a-8d7a-4273-aa29-159049b66b3b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:41.864951 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e817af7a-8d7a-4273-aa29-159049b66b3b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:42.007411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e817af7a-8d7a-4273-aa29-159049b66b3b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:42.015323 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e817af7a-8d7a-4273-aa29-159049b66b3b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1550 microversion: 2.1 time: 0.164614 Oct 06 12:30:42.021770 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 454/915] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:41 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1550 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:42.038714 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-040265c5-e33b-442a-88bf-954cb0ab2148 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:42.039202 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-040265c5-e33b-442a-88bf-954cb0ab2148 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:42.045986 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-040265c5-e33b-442a-88bf-954cb0ab2148 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:42.046482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-040265c5-e33b-442a-88bf-954cb0ab2148 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:42.046915 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-040265c5-e33b-442a-88bf-954cb0ab2148 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:42.047645 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-040265c5-e33b-442a-88bf-954cb0ab2148 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:42.048441 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-040265c5-e33b-442a-88bf-954cb0ab2148 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:42.049022 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-040265c5-e33b-442a-88bf-954cb0ab2148 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:42.109650 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-caca3f83-040a-41b2-846f-937ef0881583 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Action: 'create', calling method: .version_select at 0x7f03aabd09d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1529545223"}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:42.131836 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-040265c5-e33b-442a-88bf-954cb0ab2148 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096816 Oct 06 12:30:42.132432 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 455/916] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 12:30:42 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:42.183347 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c4c93857-523e-4055-95be-6d9c426b60ef tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:42.184187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c4c93857-523e-4055-95be-6d9c426b60ef tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:42.191272 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c4c93857-523e-4055-95be-6d9c426b60ef tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:42.191861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c4c93857-523e-4055-95be-6d9c426b60ef tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:42.192443 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c4c93857-523e-4055-95be-6d9c426b60ef tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:42.193157 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c4c93857-523e-4055-95be-6d9c426b60ef tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:42.193612 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c4c93857-523e-4055-95be-6d9c426b60ef tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:42.194245 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c4c93857-523e-4055-95be-6d9c426b60ef tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:42.344847 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c4c93857-523e-4055-95be-6d9c426b60ef tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:42.354085 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c4c93857-523e-4055-95be-6d9c426b60ef tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:42.355579 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c4c93857-523e-4055-95be-6d9c426b60ef tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:42.356762 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c4c93857-523e-4055-95be-6d9c426b60ef tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.178373 Oct 06 12:30:42.357608 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 456/917] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:42 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:30:42.433242 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-caca3f83-040a-41b2-846f-937ef0881583 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.463310 Oct 06 12:30:42.441864 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 462/918] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Oct 6 12:30:41 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 465 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 06 12:30:42.447340 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ceedf47e-ef4d-44d1-911e-af6bf079dec6 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03aa69bee0>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:42.501021 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ceedf47e-ef4d-44d1-911e-af6bf079dec6 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072" status: 200 len: 345 microversion: 2.1 time: 0.058040 Oct 06 12:30:42.501597 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 457/919] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 12:30:42 2022] GET /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:42.836945 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7562c887-9080-49ff-a942-ed989d8af4f7 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1981812851"}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:42.837512 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7562c887-9080-49ff-a942-ed989d8af4f7 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:42.844421 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7562c887-9080-49ff-a942-ed989d8af4f7 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:42.844919 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7562c887-9080-49ff-a942-ed989d8af4f7 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:42.845358 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7562c887-9080-49ff-a942-ed989d8af4f7 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:42.846057 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7562c887-9080-49ff-a942-ed989d8af4f7 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:42.846519 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7562c887-9080-49ff-a942-ed989d8af4f7 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:42.846951 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7562c887-9080-49ff-a942-ed989d8af4f7 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:42.976715 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.network.security_group_api [None req-7562c887-9080-49ff-a942-ed989d8af4f7 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Removing security group 950d9b58-485d-4fdd-98f4-f02892e128cf from port 9a4b9943-b074-4a4d-a9c2-a11438741a56 Oct 06 12:30:43.135874 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-ab229c0d-8d16-4c23-b680-0684601fe2e8 req-13b88a2d-efde-404f-9933-74a86eff852e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c71fe8d-fb4e-4848-9b99-318ccbb0ba14", "tag": "abc2aa64-ae2d-47b6-9296-fa6c134455a2"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:43.146330 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-ab229c0d-8d16-4c23-b680-0684601fe2e8 req-13b88a2d-efde-404f-9933-74a86eff852e service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:43.146817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-ab229c0d-8d16-4c23-b680-0684601fe2e8 req-13b88a2d-efde-404f-9933-74a86eff852e service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:43.147245 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-ab229c0d-8d16-4c23-b680-0684601fe2e8 req-13b88a2d-efde-404f-9933-74a86eff852e service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:43.158516 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-ab229c0d-8d16-4c23-b680-0684601fe2e8 req-13b88a2d-efde-404f-9933-74a86eff852e service nova] Creating event network-changed:abc2aa64-ae2d-47b6-9296-fa6c134455a2 for instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 on hv-cinder-85604 Oct 06 12:30:43.163408 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-ab229c0d-8d16-4c23-b680-0684601fe2e8 req-13b88a2d-efde-404f-9933-74a86eff852e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031815 Oct 06 12:30:43.164423 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 458/920] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:43.382572 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-bd796cd3-7ade-4148-bd84-a422eae966f9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:43.383477 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-bd796cd3-7ade-4148-bd84-a422eae966f9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:43.390285 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bd796cd3-7ade-4148-bd84-a422eae966f9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:43.390865 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bd796cd3-7ade-4148-bd84-a422eae966f9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:43.391637 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bd796cd3-7ade-4148-bd84-a422eae966f9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:43.392339 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bd796cd3-7ade-4148-bd84-a422eae966f9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:43.393330 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bd796cd3-7ade-4148-bd84-a422eae966f9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:43.393763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bd796cd3-7ade-4148-bd84-a422eae966f9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:43.412970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7562c887-9080-49ff-a942-ed989d8af4f7 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "POST /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/action" status: 202 len: 0 microversion: 2.1 time: 0.680234 Oct 06 12:30:43.414418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 463/921] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 12:30:42 2022] POST /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 12:30:43.432994 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-3230d236-e157-4225-a0dc-d712f8f26443 req-bf896928-51fe-49ee-99e4-dfc209170435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb42d057-804d-4d87-953a-953bf69fe126", "tag": "9a4b9943-b074-4a4d-a9c2-a11438741a56"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:43.447881 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-3230d236-e157-4225-a0dc-d712f8f26443 req-bf896928-51fe-49ee-99e4-dfc209170435 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:43.449752 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-3230d236-e157-4225-a0dc-d712f8f26443 req-bf896928-51fe-49ee-99e4-dfc209170435 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:43.450369 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-3230d236-e157-4225-a0dc-d712f8f26443 req-bf896928-51fe-49ee-99e4-dfc209170435 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:43.462849 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-3230d236-e157-4225-a0dc-d712f8f26443 req-bf896928-51fe-49ee-99e4-dfc209170435 service nova] Creating event network-changed:9a4b9943-b074-4a4d-a9c2-a11438741a56 for instance eb42d057-804d-4d87-953a-953bf69fe126 on hv-cinder-85604 Oct 06 12:30:43.468330 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-3230d236-e157-4225-a0dc-d712f8f26443 req-bf896928-51fe-49ee-99e4-dfc209170435 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040388 Oct 06 12:30:43.469568 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 464/922] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:43.518530 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-31f35c31-e1fb-44b4-a412-53a8460d9240 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03aabc9040>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:43.642002 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-31f35c31-e1fb-44b4-a412-53a8460d9240 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072" status: 200 len: 346 microversion: 2.1 time: 0.128625 Oct 06 12:30:43.643021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 465/923] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 12:30:43 2022] GET /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072 => generated 346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:43.660754 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-057f1a84-1baf-4ad2-b25b-06d136e2b67a tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Action: 'create', calling method: .version_select at 0x7f03aaf73ee0>, body: {"snapshot": {"volume_id": "733e8bf3-84c6-4d55-8bd2-6dcbca890072", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-689704846"}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:43.828417 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-bd796cd3-7ade-4148-bd84-a422eae966f9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:43.843292 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-bd796cd3-7ade-4148-bd84-a422eae966f9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:43.844890 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-bd796cd3-7ade-4148-bd84-a422eae966f9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:43.852111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-057f1a84-1baf-4ad2-b25b-06d136e2b67a tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.199082 Oct 06 12:30:43.852816 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 466/924] 10.222.0.33 () {60 vars in 1162 bytes} [Thu Oct 6 12:30:43 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:43.864641 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-bd796cd3-7ade-4148-bd84-a422eae966f9 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.486260 Oct 06 12:30:43.864890 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0d924227-f288-4bf5-b538-c2c754d93203 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03ae304a60>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:43.867900 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 459/925] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:43 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:30:43.910028 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-0d924227-f288-4bf5-b538-c2c754d93203 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72" status: 200 len: 286 microversion: 2.1 time: 0.049054 Oct 06 12:30:43.910523 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 467/926] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 12:30:43 2022] GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:43.924616 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9b344d3b-c3fa-47c6-9ac0-f22b0aad226e tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03aa6c91f0>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:43.945453 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-a99ad2f7-f7b6-49a2-8e73-d7fa4c2b577c req-4559550d-8b80-4c19-8fd9-4fd06947ab49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c743b80a-43e9-4dc1-a570-6873a5992f34", "name": "network-vif-plugged", "status": "completed", "tag": "fc7be519-3630-4616-ad76-14402cf4ad87"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:43.961603 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-a99ad2f7-f7b6-49a2-8e73-d7fa4c2b577c req-4559550d-8b80-4c19-8fd9-4fd06947ab49 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:43.963021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-a99ad2f7-f7b6-49a2-8e73-d7fa4c2b577c req-4559550d-8b80-4c19-8fd9-4fd06947ab49 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:43.963748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-a99ad2f7-f7b6-49a2-8e73-d7fa4c2b577c req-4559550d-8b80-4c19-8fd9-4fd06947ab49 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:43.966879 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9b344d3b-c3fa-47c6-9ac0-f22b0aad226e tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.047373 Oct 06 12:30:43.967687 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 460/927] 10.222.0.33 () {58 vars in 1140 bytes} [Thu Oct 6 12:30:43 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:43.982781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4f229715-de5b-49e9-b868-ae2dcb13f708 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03ae20d1f0>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:44.002411 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-a99ad2f7-f7b6-49a2-8e73-d7fa4c2b577c req-4559550d-8b80-4c19-8fd9-4fd06947ab49 service nova] Creating event network-vif-plugged:fc7be519-3630-4616-ad76-14402cf4ad87 for instance c743b80a-43e9-4dc1-a570-6873a5992f34 on hv-cinder-85604 Oct 06 12:30:44.007795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-a99ad2f7-f7b6-49a2-8e73-d7fa4c2b577c req-4559550d-8b80-4c19-8fd9-4fd06947ab49 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067559 Oct 06 12:30:44.009013 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 468/928] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:44.019107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4f229715-de5b-49e9-b868-ae2dcb13f708 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72" status: 200 len: 286 microversion: 2.1 time: 0.043064 Oct 06 12:30:44.024523 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 461/929] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 12:30:43 2022] GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:44.892915 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-03d49d37-57b8-44cd-9d47-1b3a2e6b095a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:44.893530 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-03d49d37-57b8-44cd-9d47-1b3a2e6b095a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:44.900276 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-03d49d37-57b8-44cd-9d47-1b3a2e6b095a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:44.900766 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-03d49d37-57b8-44cd-9d47-1b3a2e6b095a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:44.901343 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-03d49d37-57b8-44cd-9d47-1b3a2e6b095a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:44.902406 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-03d49d37-57b8-44cd-9d47-1b3a2e6b095a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:44.902903 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-03d49d37-57b8-44cd-9d47-1b3a2e6b095a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:44.903325 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-03d49d37-57b8-44cd-9d47-1b3a2e6b095a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:45.033279 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2f19523f-42ef-4912-93f4-84c1d0190358 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03aa708790>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:45.068692 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2f19523f-42ef-4912-93f4-84c1d0190358 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72" status: 200 len: 286 microversion: 2.1 time: 0.040334 Oct 06 12:30:45.069290 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 462/930] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 12:30:45 2022] GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:45.140259 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-03d49d37-57b8-44cd-9d47-1b3a2e6b095a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:45.148908 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-03d49d37-57b8-44cd-9d47-1b3a2e6b095a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:45.152565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-03d49d37-57b8-44cd-9d47-1b3a2e6b095a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:45.152565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-03d49d37-57b8-44cd-9d47-1b3a2e6b095a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.263138 Oct 06 12:30:45.152565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 469/931] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:44 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:45.158903 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9d67a865-2a6e-4b66-9548-dfd58824495e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:45.160279 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9d67a865-2a6e-4b66-9548-dfd58824495e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:45.172390 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9d67a865-2a6e-4b66-9548-dfd58824495e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:45.173230 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9d67a865-2a6e-4b66-9548-dfd58824495e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:45.173828 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9d67a865-2a6e-4b66-9548-dfd58824495e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:45.174704 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9d67a865-2a6e-4b66-9548-dfd58824495e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:45.175310 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9d67a865-2a6e-4b66-9548-dfd58824495e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:45.175927 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9d67a865-2a6e-4b66-9548-dfd58824495e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:45.258449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-9d67a865-2a6e-4b66-9548-dfd58824495e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lazy-loading 'services' on Instance uuid eb42d057-804d-4d87-953a-953bf69fe126 {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:30:45.335933 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9d67a865-2a6e-4b66-9548-dfd58824495e tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments/c79956b2-ce79-46f0-890e-d7ac69ad9081" status: 202 len: 0 microversion: 2.1 time: 0.181822 Oct 06 12:30:45.340125 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 463/932] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 12:30:45 2022] DELETE /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments/c79956b2-ce79-46f0-890e-d7ac69ad9081 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:30:45.345357 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-cc053bfa-df20-4ac5-8d9a-c4a047f80ed3 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:45.347485 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-cc053bfa-df20-4ac5-8d9a-c4a047f80ed3 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:45.353839 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cc053bfa-df20-4ac5-8d9a-c4a047f80ed3 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:45.354321 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cc053bfa-df20-4ac5-8d9a-c4a047f80ed3 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:45.354750 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cc053bfa-df20-4ac5-8d9a-c4a047f80ed3 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:45.355433 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cc053bfa-df20-4ac5-8d9a-c4a047f80ed3 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:45.355914 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cc053bfa-df20-4ac5-8d9a-c4a047f80ed3 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:45.356336 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cc053bfa-df20-4ac5-8d9a-c4a047f80ed3 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:45.387548 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-cc053bfa-df20-4ac5-8d9a-c4a047f80ed3 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046027 Oct 06 12:30:45.388107 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 470/933] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:30:45 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:45.500583 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-f0aefc04-f8cf-4bb8-81d6-aef0334ddb67 req-ee94a026-f34a-47f6-a4c3-ab3ed732b4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb42d057-804d-4d87-953a-953bf69fe126", "tag": "9a4b9943-b074-4a4d-a9c2-a11438741a56"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:45.510894 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-f0aefc04-f8cf-4bb8-81d6-aef0334ddb67 req-ee94a026-f34a-47f6-a4c3-ab3ed732b4bc service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:45.511474 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-f0aefc04-f8cf-4bb8-81d6-aef0334ddb67 req-ee94a026-f34a-47f6-a4c3-ab3ed732b4bc service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:45.512006 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-f0aefc04-f8cf-4bb8-81d6-aef0334ddb67 req-ee94a026-f34a-47f6-a4c3-ab3ed732b4bc service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:45.523009 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-f0aefc04-f8cf-4bb8-81d6-aef0334ddb67 req-ee94a026-f34a-47f6-a4c3-ab3ed732b4bc service nova] Creating event network-changed:9a4b9943-b074-4a4d-a9c2-a11438741a56 for instance eb42d057-804d-4d87-953a-953bf69fe126 on hv-cinder-85604 Oct 06 12:30:45.527790 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-f0aefc04-f8cf-4bb8-81d6-aef0334ddb67 req-ee94a026-f34a-47f6-a4c3-ab3ed732b4bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031168 Oct 06 12:30:45.528380 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 464/934] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:46.082501 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f4e46733-fd0a-4781-8540-f8834d5e1cbc tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03ae2e1b80>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:46.114281 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f4e46733-fd0a-4781-8540-f8834d5e1cbc tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72" status: 200 len: 286 microversion: 2.1 time: 0.035974 Oct 06 12:30:46.114926 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 471/935] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 12:30:46 2022] GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:46.177441 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-500555ad-7677-4562-9cef-76f740bc42a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:46.178257 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-500555ad-7677-4562-9cef-76f740bc42a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:46.184930 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-500555ad-7677-4562-9cef-76f740bc42a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:46.185572 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-500555ad-7677-4562-9cef-76f740bc42a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:46.185841 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-500555ad-7677-4562-9cef-76f740bc42a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:46.186530 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-500555ad-7677-4562-9cef-76f740bc42a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:46.186981 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-500555ad-7677-4562-9cef-76f740bc42a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:46.187408 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-500555ad-7677-4562-9cef-76f740bc42a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:46.319633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-500555ad-7677-4562-9cef-76f740bc42a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:46.328190 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-500555ad-7677-4562-9cef-76f740bc42a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:46.329649 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-500555ad-7677-4562-9cef-76f740bc42a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:46.330755 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-500555ad-7677-4562-9cef-76f740bc42a8 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.158094 Oct 06 12:30:46.331346 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 465/936] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:46 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:46.400436 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-919fab4d-3e18-450e-bb76-751ebd8536cc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:46.402556 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-919fab4d-3e18-450e-bb76-751ebd8536cc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:46.409149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-919fab4d-3e18-450e-bb76-751ebd8536cc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:46.409628 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-919fab4d-3e18-450e-bb76-751ebd8536cc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:46.410057 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-919fab4d-3e18-450e-bb76-751ebd8536cc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:46.410736 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-919fab4d-3e18-450e-bb76-751ebd8536cc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:46.411191 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-919fab4d-3e18-450e-bb76-751ebd8536cc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:46.411646 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-919fab4d-3e18-450e-bb76-751ebd8536cc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:46.440768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-919fab4d-3e18-450e-bb76-751ebd8536cc tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044531 Oct 06 12:30:46.441390 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 472/937] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:30:46 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:47.127852 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ee99cd1c-7b82-4c80-951a-a22eb1f3cbca tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03aa69b820>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:47.158482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ee99cd1c-7b82-4c80-951a-a22eb1f3cbca tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72" status: 200 len: 286 microversion: 2.1 time: 0.034396 Oct 06 12:30:47.159035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 466/938] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 12:30:47 2022] GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:47.356851 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f4bb2e3c-ef05-4b8e-b634-f04523bc030a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:47.357497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f4bb2e3c-ef05-4b8e-b634-f04523bc030a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:47.361278 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:47.365604 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4bb2e3c-ef05-4b8e-b634-f04523bc030a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:47.366090 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4bb2e3c-ef05-4b8e-b634-f04523bc030a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:47.366523 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4bb2e3c-ef05-4b8e-b634-f04523bc030a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:47.367215 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4bb2e3c-ef05-4b8e-b634-f04523bc030a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:47.367701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4bb2e3c-ef05-4b8e-b634-f04523bc030a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:47.368130 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4bb2e3c-ef05-4b8e-b634-f04523bc030a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:47.454654 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-1cf2aabf-e857-4987-b4df-76fc234e4656 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:47.457003 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-1cf2aabf-e857-4987-b4df-76fc234e4656 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:47.464448 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1cf2aabf-e857-4987-b4df-76fc234e4656 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:47.464939 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1cf2aabf-e857-4987-b4df-76fc234e4656 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:47.465380 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1cf2aabf-e857-4987-b4df-76fc234e4656 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:47.466085 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1cf2aabf-e857-4987-b4df-76fc234e4656 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:47.466577 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1cf2aabf-e857-4987-b4df-76fc234e4656 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:47.467007 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1cf2aabf-e857-4987-b4df-76fc234e4656 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:47.496170 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-1cf2aabf-e857-4987-b4df-76fc234e4656 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045959 Oct 06 12:30:47.497176 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 467/939] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:30:47 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:30:47.499252 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f4bb2e3c-ef05-4b8e-b634-f04523bc030a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:47.509748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f4bb2e3c-ef05-4b8e-b634-f04523bc030a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:47.511178 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f4bb2e3c-ef05-4b8e-b634-f04523bc030a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:47.512308 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f4bb2e3c-ef05-4b8e-b634-f04523bc030a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.159504 Oct 06 12:30:47.512898 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 473/940] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:47 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:48.172023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-bdd6e4e6-f312-4726-8c0b-61e945415446 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03ae2aaee0>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:48.201288 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-bdd6e4e6-f312-4726-8c0b-61e945415446 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72" status: 200 len: 286 microversion: 2.1 time: 0.033139 Oct 06 12:30:48.201849 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 468/941] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 12:30:48 2022] GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:48.509605 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-caaecf95-65c5-4527-b1b0-6bd47ab86a61 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:48.511718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-caaecf95-65c5-4527-b1b0-6bd47ab86a61 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:48.517947 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-caaecf95-65c5-4527-b1b0-6bd47ab86a61 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:48.518425 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-caaecf95-65c5-4527-b1b0-6bd47ab86a61 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:48.518854 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-caaecf95-65c5-4527-b1b0-6bd47ab86a61 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:48.519554 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-caaecf95-65c5-4527-b1b0-6bd47ab86a61 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:48.520034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-caaecf95-65c5-4527-b1b0-6bd47ab86a61 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:48.520457 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-caaecf95-65c5-4527-b1b0-6bd47ab86a61 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:48.537827 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-fa9ec531-a139-40e6-bbb2-199c58887b62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:48.538435 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-fa9ec531-a139-40e6-bbb2-199c58887b62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:48.544342 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fa9ec531-a139-40e6-bbb2-199c58887b62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:48.544860 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fa9ec531-a139-40e6-bbb2-199c58887b62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:48.545307 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fa9ec531-a139-40e6-bbb2-199c58887b62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:48.546069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fa9ec531-a139-40e6-bbb2-199c58887b62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:48.546527 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fa9ec531-a139-40e6-bbb2-199c58887b62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:48.546957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fa9ec531-a139-40e6-bbb2-199c58887b62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:48.548923 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-caaecf95-65c5-4527-b1b0-6bd47ab86a61 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043822 Oct 06 12:30:48.549482 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 474/942] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:30:48 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:48.680388 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fa9ec531-a139-40e6-bbb2-199c58887b62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:48.689244 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fa9ec531-a139-40e6-bbb2-199c58887b62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:48.690685 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fa9ec531-a139-40e6-bbb2-199c58887b62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:48.691840 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-fa9ec531-a139-40e6-bbb2-199c58887b62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.158321 Oct 06 12:30:48.692403 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 469/943] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:48 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:30:49.214573 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-29a7453b-87a1-4e6f-b25f-f25775bf295c tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03ae2dfe50>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:49.243669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-29a7453b-87a1-4e6f-b25f-f25775bf295c tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72" status: 200 len: 287 microversion: 2.1 time: 0.033347 Oct 06 12:30:49.244238 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 475/944] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 12:30:49 2022] GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:49.255351 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-eae81334-d01f-481a-93b4-542e6700ae2b tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03aa6bd160>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:49.312406 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-eae81334-d01f-481a-93b4-542e6700ae2b tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72" status: 202 len: 0 microversion: 2.1 time: 0.060803 Oct 06 12:30:49.312975 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 470/945] 10.222.0.33 () {58 vars in 1254 bytes} [Thu Oct 6 12:30:49 2022] DELETE /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:30:49.321965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-185546e6-ea93-4995-8204-e1560200c4ab tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03ae2e1ee0>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:49.352391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-185546e6-ea93-4995-8204-e1560200c4ab tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72" status: 200 len: 286 microversion: 2.1 time: 0.034972 Oct 06 12:30:49.353042 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 476/946] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 12:30:49 2022] GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:49.561521 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-38edc837-0261-4b9f-b4b4-9e71710a056f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:49.564339 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-38edc837-0261-4b9f-b4b4-9e71710a056f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:49.567791 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:49.572494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-38edc837-0261-4b9f-b4b4-9e71710a056f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:49.572986 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-38edc837-0261-4b9f-b4b4-9e71710a056f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:49.573423 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-38edc837-0261-4b9f-b4b4-9e71710a056f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:49.574115 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-38edc837-0261-4b9f-b4b4-9e71710a056f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:49.574575 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-38edc837-0261-4b9f-b4b4-9e71710a056f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:49.575003 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-38edc837-0261-4b9f-b4b4-9e71710a056f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:49.606126 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-38edc837-0261-4b9f-b4b4-9e71710a056f tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049062 Oct 06 12:30:49.606690 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 471/947] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:30:49 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:49.716637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e8a36adf-2bd0-4ddc-8779-2971bbc50e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:49.717404 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e8a36adf-2bd0-4ddc-8779-2971bbc50e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:49.724067 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e8a36adf-2bd0-4ddc-8779-2971bbc50e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:49.724560 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e8a36adf-2bd0-4ddc-8779-2971bbc50e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:49.725766 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e8a36adf-2bd0-4ddc-8779-2971bbc50e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:49.726478 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e8a36adf-2bd0-4ddc-8779-2971bbc50e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:49.727355 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e8a36adf-2bd0-4ddc-8779-2971bbc50e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:49.728112 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e8a36adf-2bd0-4ddc-8779-2971bbc50e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:49.864078 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e8a36adf-2bd0-4ddc-8779-2971bbc50e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:49.872527 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e8a36adf-2bd0-4ddc-8779-2971bbc50e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:49.873966 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e8a36adf-2bd0-4ddc-8779-2971bbc50e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:49.875092 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e8a36adf-2bd0-4ddc-8779-2971bbc50e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1407 microversion: 2.20 time: 0.163285 Oct 06 12:30:49.875665 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 477/948] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:49 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:50.365183 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ea56a76b-bafd-4777-845e-1d61a62e0abf tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03aa7483a0>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:50.390403 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-ea56a76b-bafd-4777-845e-1d61a62e0abf tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] HTTP exception thrown: Snapshot f795b181-4953-4e10-a884-e4d4d8c1dd72 could not be found. Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ea56a76b-bafd-4777-845e-1d61a62e0abf tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Request method failure captured: Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72 HTTP/1.1 Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPspxgbXi51POEZr89XG0ncQ6GIZ5sizUAbHZUdBq5vE5TQpvk5XHx__xh7NoiYUuu_dFsgKwYurNj5f8mV9Wpsh9-pv_kF0vhJV7LQ-tobb_tM1zRpM69h6LselQHljlWp62pNKjuVmGxFIEsKh2HTnjd2WDepSkkpdMlbj7vm7pYOU Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 8fc55bc6e41843008da265a1e09e69e0 Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-928285167 Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:30:50.392742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:30:50.394420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fc55bc6e41843008da265a1e09e69e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fc55bc6e41843008da265a1e09e69e0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fc55bc6e41843008da265a1e09e69e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fc55bc6e41843008da265a1e09e69e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:30:50.394420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-VolumesSnapshotsTestJSON-928285167 Oct 06 12:30:50.394420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 8fc55bc6e41843008da265a1e09e69e0 Oct 06 12:30:50.394420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-928285167 Oct 06 12:30:50.394420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-VolumesSnapshotsTestJSON-928285167-project Oct 06 12:30:50.394420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:30:50.394420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:30:50.394420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 1670b0971f584c629e0c5fa018f57156 Oct 06 12:30:50.394420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-VolumesSnapshotsTestJSON-928285167-project Oct 06 12:30:50.394420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: Oct 06 12:30:50.394420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Snapshot f795b181-4953-4e10-a884-e4d4d8c1dd72 could not be found. Oct 06 12:30:50.394420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': 'f795b181-4953-4e10-a884-e4d4d8c1dd72'} Oct 06 12:30:50.394420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f795b181-4953-4e10-a884-e4d4d8c1dd72 could not be found. (HTTP 404) (Request-ID: req-720a3b33-77a6-4eea-af1f-03d6747493d3) Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:50.395863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 12:30:50.397303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f795b181-4953-4e10-a884-e4d4d8c1dd72 could not be found. Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 06 12:30:50.398698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:30:50.400255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f795b181-4953-4e10-a884-e4d4d8c1dd72 could not be found. Oct 06 12:30:50.400255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:50.400255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:50.400255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:50.400255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:50.400255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:50.400255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:50.400255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:30:50.400255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:30:50.400255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f795b181-4953-4e10-a884-e4d4d8c1dd72 could not be found. Oct 06 12:30:50.400255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:50.400255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ea56a76b-bafd-4777-845e-1d61a62e0abf tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Returning 404 to user: Snapshot f795b181-4953-4e10-a884-e4d4d8c1dd72 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:30:50.400255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ea56a76b-bafd-4777-845e-1d61a62e0abf tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72" status: 404 len: 111 microversion: 2.1 time: 0.032761 Oct 06 12:30:50.400255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 472/949] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 12:30:50 2022] GET /compute/v2.1/os-snapshots/f795b181-4953-4e10-a884-e4d4d8c1dd72 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:30:50.403382 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6e4c9313-44af-444f-9dc8-4b80fabbbd14 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03ae2df3a0>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:50.462578 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-6e4c9313-44af-444f-9dc8-4b80fabbbd14 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072" status: 202 len: 0 microversion: 2.1 time: 0.062958 Oct 06 12:30:50.463141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 478/950] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 12:30:50 2022] DELETE /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:30:50.471268 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0add1d3f-40e3-4736-81e4-ec94d31d0b1c tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03ae2aa790>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:50.520410 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0add1d3f-40e3-4736-81e4-ec94d31d0b1c tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072" status: 200 len: 345 microversion: 2.1 time: 0.052900 Oct 06 12:30:50.521234 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 473/951] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 12:30:50 2022] GET /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:50.618442 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4d249e80-ca1e-4349-be58-f27fc0118246 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:50.620736 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-4d249e80-ca1e-4349-be58-f27fc0118246 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:50.626620 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d249e80-ca1e-4349-be58-f27fc0118246 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:50.627106 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d249e80-ca1e-4349-be58-f27fc0118246 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:50.627571 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d249e80-ca1e-4349-be58-f27fc0118246 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:50.628270 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d249e80-ca1e-4349-be58-f27fc0118246 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:50.628734 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d249e80-ca1e-4349-be58-f27fc0118246 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:50.629166 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d249e80-ca1e-4349-be58-f27fc0118246 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:50.659497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4d249e80-ca1e-4349-be58-f27fc0118246 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Oct 06 12:30:50.660067 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 479/952] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:30:50 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:50.901527 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d71adf72-85e8-41a9-a9ac-ab031d0a50f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:50.902213 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d71adf72-85e8-41a9-a9ac-ab031d0a50f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:50.908782 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d71adf72-85e8-41a9-a9ac-ab031d0a50f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:50.909266 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d71adf72-85e8-41a9-a9ac-ab031d0a50f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:50.909733 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d71adf72-85e8-41a9-a9ac-ab031d0a50f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:50.910517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d71adf72-85e8-41a9-a9ac-ab031d0a50f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:50.911039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d71adf72-85e8-41a9-a9ac-ab031d0a50f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:50.911563 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d71adf72-85e8-41a9-a9ac-ab031d0a50f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:51.106818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d71adf72-85e8-41a9-a9ac-ab031d0a50f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:51.117555 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d71adf72-85e8-41a9-a9ac-ab031d0a50f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:51.121170 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d71adf72-85e8-41a9-a9ac-ab031d0a50f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:51.124059 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d71adf72-85e8-41a9-a9ac-ab031d0a50f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1598 microversion: 2.20 time: 0.226223 Oct 06 12:30:51.125014 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 474/953] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:30:50 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1598 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:30:51.152253 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-41a0f2a1-f10f-4d5a-86d4-b94f9420ef2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:51.152787 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-41a0f2a1-f10f-4d5a-86d4-b94f9420ef2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:51.159193 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-41a0f2a1-f10f-4d5a-86d4-b94f9420ef2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:51.159732 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-41a0f2a1-f10f-4d5a-86d4-b94f9420ef2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:51.160305 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-41a0f2a1-f10f-4d5a-86d4-b94f9420ef2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:51.163277 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-41a0f2a1-f10f-4d5a-86d4-b94f9420ef2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:51.163828 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-41a0f2a1-f10f-4d5a-86d4-b94f9420ef2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:51.164275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-41a0f2a1-f10f-4d5a-86d4-b94f9420ef2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:51.282517 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-41a0f2a1-f10f-4d5a-86d4-b94f9420ef2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.135684 Oct 06 12:30:51.291787 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 480/954] 10.222.0.33 () {60 vars in 1316 bytes} [Thu Oct 6 12:30:51 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:30:51.535862 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8a4cc5f7-b90e-4419-907a-dac14774b28d tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03ae2a14c0>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:51.573259 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-8a4cc5f7-b90e-4419-907a-dac14774b28d tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] HTTP exception thrown: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8a4cc5f7-b90e-4419-907a-dac14774b28d tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Request method failure captured: Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072 HTTP/1.1 Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPspxgbXi51POEZr89XG0ncQ6GIZ5sizUAbHZUdBq5vE5TQpvk5XHx__xh7NoiYUuu_dFsgKwYurNj5f8mV9Wpsh9-pv_kF0vhJV7LQ-tobb_tM1zRpM69h6LselQHljlWp62pNKjuVmGxFIEsKh2HTnjd2WDepSkkpdMlbj7vm7pYOU Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 8fc55bc6e41843008da265a1e09e69e0 Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-928285167 Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:30:51.576781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:30:51.578411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fc55bc6e41843008da265a1e09e69e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fc55bc6e41843008da265a1e09e69e0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fc55bc6e41843008da265a1e09e69e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fc55bc6e41843008da265a1e09e69e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:30:51.578411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-VolumesSnapshotsTestJSON-928285167 Oct 06 12:30:51.578411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 8fc55bc6e41843008da265a1e09e69e0 Oct 06 12:30:51.578411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-928285167 Oct 06 12:30:51.578411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-VolumesSnapshotsTestJSON-928285167-project Oct 06 12:30:51.578411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:30:51.578411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:30:51.578411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 1670b0971f584c629e0c5fa018f57156 Oct 06 12:30:51.578411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-VolumesSnapshotsTestJSON-928285167-project Oct 06 12:30:51.578411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: Oct 06 12:30:51.578411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. Oct 06 12:30:51.578411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '733e8bf3-84c6-4d55-8bd2-6dcbca890072'} Oct 06 12:30:51.578411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. (HTTP 404) (Request-ID: req-6eecee15-1106-4b7c-a21f-0244018bdff7) Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:51.579482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 12:30:51.581280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 12:30:51.582887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:30:51.584249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. Oct 06 12:30:51.584249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.584249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:51.584249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.584249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:51.584249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:51.584249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:51.584249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:30:51.584249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:30:51.584249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. Oct 06 12:30:51.584249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.584249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8a4cc5f7-b90e-4419-907a-dac14774b28d tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Returning 404 to user: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:30:51.584249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8a4cc5f7-b90e-4419-907a-dac14774b28d tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072" status: 404 len: 109 microversion: 2.1 time: 0.047712 Oct 06 12:30:51.584249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 475/955] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 12:30:51 2022] GET /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:30:51.600232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5d79fccd-4ea1-41db-8eb2-d425597c8021 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03ae2e1700>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:51.632420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-5d79fccd-4ea1-41db-8eb2-d425597c8021 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] HTTP exception thrown: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5d79fccd-4ea1-41db-8eb2-d425597c8021 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Request method failure captured: Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: DELETE /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072 HTTP/1.1 Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPspxgbXi51POEZr89XG0ncQ6GIZ5sizUAbHZUdBq5vE5TQpvk5XHx__xh7NoiYUuu_dFsgKwYurNj5f8mV9Wpsh9-pv_kF0vhJV7LQ-tobb_tM1zRpM69h6LselQHljlWp62pNKjuVmGxFIEsKh2HTnjd2WDepSkkpdMlbj7vm7pYOU Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: 8fc55bc6e41843008da265a1e09e69e0 Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-928285167 Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:30:51.635208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:30:51.636796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fc55bc6e41843008da265a1e09e69e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fc55bc6e41843008da265a1e09e69e0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fc55bc6e41843008da265a1e09e69e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fc55bc6e41843008da265a1e09e69e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:30:51.636796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-VolumesSnapshotsTestJSON-928285167 Oct 06 12:30:51.636796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: 8fc55bc6e41843008da265a1e09e69e0 Oct 06 12:30:51.636796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-928285167 Oct 06 12:30:51.636796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-VolumesSnapshotsTestJSON-928285167-project Oct 06 12:30:51.636796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:30:51.636796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:30:51.636796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 1670b0971f584c629e0c5fa018f57156 Oct 06 12:30:51.636796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-VolumesSnapshotsTestJSON-928285167-project Oct 06 12:30:51.636796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: Oct 06 12:30:51.636796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. Oct 06 12:30:51.636796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '733e8bf3-84c6-4d55-8bd2-6dcbca890072'} Oct 06 12:30:51.636796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. (HTTP 404) (Request-ID: req-57cdc586-f66e-4778-acfc-097619e04f15) Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:51.637894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 12:30:51.639176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 06 12:30:51.640391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:30:51.641795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. Oct 06 12:30:51.641795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.641795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:51.641795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.641795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:51.641795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:51.641795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:51.641795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:30:51.641795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:30:51.641795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. Oct 06 12:30:51.641795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.641795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5d79fccd-4ea1-41db-8eb2-d425597c8021 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Returning 404 to user: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:30:51.641795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5d79fccd-4ea1-41db-8eb2-d425597c8021 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072" status: 404 len: 109 microversion: 2.1 time: 0.043289 Oct 06 12:30:51.641795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 481/956] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 12:30:51 2022] DELETE /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:30:51.648298 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-86504f45-c1b5-42fa-8eb8-90ecff5a9472 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Calling method '.version_select at 0x7f03ae20d280>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:51.673877 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4a69e3f3-9c89-465b-acbe-9fb8af3d7f52 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:51.677186 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-4a69e3f3-9c89-465b-acbe-9fb8af3d7f52 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:51.684536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-86504f45-c1b5-42fa-8eb8-90ecff5a9472 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] HTTP exception thrown: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-86504f45-c1b5-42fa-8eb8-90ecff5a9472 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Request method failure captured: Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072 HTTP/1.1 Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPspxgbXi51POEZr89XG0ncQ6GIZ5sizUAbHZUdBq5vE5TQpvk5XHx__xh7NoiYUuu_dFsgKwYurNj5f8mV9Wpsh9-pv_kF0vhJV7LQ-tobb_tM1zRpM69h6LselQHljlWp62pNKjuVmGxFIEsKh2HTnjd2WDepSkkpdMlbj7vm7pYOU Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 8fc55bc6e41843008da265a1e09e69e0 Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-928285167 Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:30:51.686887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:30:51.688507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fc55bc6e41843008da265a1e09e69e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fc55bc6e41843008da265a1e09e69e0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fc55bc6e41843008da265a1e09e69e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fc55bc6e41843008da265a1e09e69e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:30:51.688507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-VolumesSnapshotsTestJSON-928285167 Oct 06 12:30:51.688507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 8fc55bc6e41843008da265a1e09e69e0 Oct 06 12:30:51.688507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-928285167 Oct 06 12:30:51.688507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-VolumesSnapshotsTestJSON-928285167-project Oct 06 12:30:51.688507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:30:51.688507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:30:51.688507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 1670b0971f584c629e0c5fa018f57156 Oct 06 12:30:51.688507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-VolumesSnapshotsTestJSON-928285167-project Oct 06 12:30:51.688507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: Oct 06 12:30:51.688507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. Oct 06 12:30:51.688507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '733e8bf3-84c6-4d55-8bd2-6dcbca890072'} Oct 06 12:30:51.688507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. (HTTP 404) (Request-ID: req-ff54bd2b-b652-499e-8c53-8ea4b3c7f9b4) Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:51.689517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 12:30:51.690960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 12:30:51.692507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:30:51.693998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. Oct 06 12:30:51.693998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.693998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:51.693998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.693998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:51.693998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:51.693998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:51.693998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:30:51.693998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:30:51.693998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. Oct 06 12:30:51.693998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.694837 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4a69e3f3-9c89-465b-acbe-9fb8af3d7f52 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:51.694837 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4a69e3f3-9c89-465b-acbe-9fb8af3d7f52 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:51.694837 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4a69e3f3-9c89-465b-acbe-9fb8af3d7f52 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:51.697826 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4a69e3f3-9c89-465b-acbe-9fb8af3d7f52 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:51.701591 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-86504f45-c1b5-42fa-8eb8-90ecff5a9472 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] Returning 404 to user: Volume 733e8bf3-84c6-4d55-8bd2-6dcbca890072 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:30:51.701712 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4a69e3f3-9c89-465b-acbe-9fb8af3d7f52 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:51.701712 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4a69e3f3-9c89-465b-acbe-9fb8af3d7f52 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:51.701898 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-86504f45-c1b5-42fa-8eb8-90ecff5a9472 tempest-VolumesSnapshotsTestJSON-928285167 tempest-VolumesSnapshotsTestJSON-928285167-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072" status: 404 len: 109 microversion: 2.1 time: 0.053438 Oct 06 12:30:51.701898 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 476/957] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 12:30:51 2022] GET /compute/v2.1/os-volumes/733e8bf3-84c6-4d55-8bd2-6dcbca890072 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:30:51.740176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4a69e3f3-9c89-465b-acbe-9fb8af3d7f52 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071501 Oct 06 12:30:51.741187 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 482/958] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:30:51 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:30:51.754711 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ece0d6a0-000a-422a-8157-cccfce9efda6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:51.755357 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ece0d6a0-000a-422a-8157-cccfce9efda6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:51.764862 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ece0d6a0-000a-422a-8157-cccfce9efda6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:51.765486 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ece0d6a0-000a-422a-8157-cccfce9efda6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:51.766051 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ece0d6a0-000a-422a-8157-cccfce9efda6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:51.767164 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ece0d6a0-000a-422a-8157-cccfce9efda6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:51.768599 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ece0d6a0-000a-422a-8157-cccfce9efda6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:51.769230 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ece0d6a0-000a-422a-8157-cccfce9efda6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:51.792384 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:51.889181 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-ece0d6a0-000a-422a-8157-cccfce9efda6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] HTTP exception thrown: Instance eb42d057-804d-4d87-953a-953bf69fe126 is not attached to volume c79956b2-ce79-46f0-890e-d7ac69ad9081 Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ece0d6a0-000a-422a-8157-cccfce9efda6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Request method failure captured: Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: DELETE /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments/c79956b2-ce79-46f0-890e-d7ac69ad9081 HTTP/1.1 Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPskyqGXA6t40xYJjGKtwF3n68OJdWVUjbgBIcLcOMzYrqLL8pissJkwJqYP-dcQNah9le49D7pK0t-r311W0SrSUMiScuXJt7miyZvEo1sX_HDupysK8f5thr-cJDN4NiM4v2K8AAhEhuQp8ZnSBNVnnBdgCpLLHrscNCuSa135zS1Q Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 1c822fb7252b4804aa9a0cb228b6397c Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-TestMinimumBasicScenario-502112929 Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:30:51.899946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:30:51.901469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c822fb7252b4804aa9a0cb228b6397c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1c822fb7252b4804aa9a0cb228b6397c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c822fb7252b4804aa9a0cb228b6397c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1c822fb7252b4804aa9a0cb228b6397c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:30:51.901469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-TestMinimumBasicScenario-502112929 Oct 06 12:30:51.901469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 1c822fb7252b4804aa9a0cb228b6397c Oct 06 12:30:51.901469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-TestMinimumBasicScenario-502112929 Oct 06 12:30:51.901469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-TestMinimumBasicScenario-502112929-project Oct 06 12:30:51.901469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:30:51.901469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:30:51.901469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 196f71447aaf45fd812efb9eeba2c0cb Oct 06 12:30:51.901469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-TestMinimumBasicScenario-502112929-project Oct 06 12:30:51.901469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:30:51.901469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance eb42d057-804d-4d87-953a-953bf69fe126 is not attached to volume c79956b2-ce79-46f0-890e-d7ac69ad9081 Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'server_id': 'eb42d057-804d-4d87-953a-953bf69fe126', 'id': 'c79956b2-ce79-46f0-890e-d7ac69ad9081'} Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c79956b2-ce79-46f0-890e-d7ac69ad9081. Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:30:51.902800 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:30:51.904574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:30:51.904574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 06 12:30:51.904574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 12:30:51.904574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb42d057-804d-4d87-953a-953bf69fe126 is not attached to volume c79956b2-ce79-46f0-890e-d7ac69ad9081 Oct 06 12:30:51.904574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.904574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:51.904574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.904574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:51.904574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:51.904574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:51.904574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:30:51.904574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:30:51.904574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb42d057-804d-4d87-953a-953bf69fe126 is not attached to volume c79956b2-ce79-46f0-890e-d7ac69ad9081 Oct 06 12:30:51.904574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:51.905712 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ece0d6a0-000a-422a-8157-cccfce9efda6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Returning 404 to user: Instance eb42d057-804d-4d87-953a-953bf69fe126 is not attached to volume c79956b2-ce79-46f0-890e-d7ac69ad9081 {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:30:51.906126 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ece0d6a0-000a-422a-8157-cccfce9efda6 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments/c79956b2-ce79-46f0-890e-d7ac69ad9081" status: 404 len: 154 microversion: 2.1 time: 0.157961 Oct 06 12:30:51.906940 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 477/959] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 12:30:51 2022] DELETE /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126/os-volume_attachments/c79956b2-ce79-46f0-890e-d7ac69ad9081 => generated 154 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:30:52.795368 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-ee4e935c-4c45-4d57-b1cd-375988fb7377 req-f59f124d-e576-4eef-aa4a-80377ce99e75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c743b80a-43e9-4dc1-a570-6873a5992f34", "tag": "fc7be519-3630-4616-ad76-14402cf4ad87"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:52.805324 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-ee4e935c-4c45-4d57-b1cd-375988fb7377 req-f59f124d-e576-4eef-aa4a-80377ce99e75 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:52.806330 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-ee4e935c-4c45-4d57-b1cd-375988fb7377 req-f59f124d-e576-4eef-aa4a-80377ce99e75 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:52.806972 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-ee4e935c-4c45-4d57-b1cd-375988fb7377 req-f59f124d-e576-4eef-aa4a-80377ce99e75 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:52.821095 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-ee4e935c-4c45-4d57-b1cd-375988fb7377 req-f59f124d-e576-4eef-aa4a-80377ce99e75 service nova] Creating event network-changed:fc7be519-3630-4616-ad76-14402cf4ad87 for instance c743b80a-43e9-4dc1-a570-6873a5992f34 on hv-cinder-85604 Oct 06 12:30:52.829121 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-ee4e935c-4c45-4d57-b1cd-375988fb7377 req-f59f124d-e576-4eef-aa4a-80377ce99e75 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036724 Oct 06 12:30:52.833411 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 483/960] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:53.128601 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3f2aa868-07bf-45b2-a681-196269006660 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:53.128601 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3f2aa868-07bf-45b2-a681-196269006660 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:53.148875 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3f2aa868-07bf-45b2-a681-196269006660 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:53.150218 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3f2aa868-07bf-45b2-a681-196269006660 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:53.150985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3f2aa868-07bf-45b2-a681-196269006660 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:53.151946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3f2aa868-07bf-45b2-a681-196269006660 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:53.152925 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3f2aa868-07bf-45b2-a681-196269006660 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:53.153778 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3f2aa868-07bf-45b2-a681-196269006660 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:53.211112 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3f2aa868-07bf-45b2-a681-196269006660 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Going to try to terminate instance {{(pid=120509) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:30:53.357203 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3f2aa868-07bf-45b2-a681-196269006660 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 204 len: 0 microversion: 2.1 time: 0.240958 Oct 06 12:30:53.364703 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 478/961] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:30:53 2022] DELETE /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:30:53.370569 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-bc3f7bb0-c877-4246-993f-d653f2abecb9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:53.371275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-bc3f7bb0-c877-4246-993f-d653f2abecb9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:53.379901 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bc3f7bb0-c877-4246-993f-d653f2abecb9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:53.381581 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bc3f7bb0-c877-4246-993f-d653f2abecb9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:53.382374 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bc3f7bb0-c877-4246-993f-d653f2abecb9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:53.385007 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bc3f7bb0-c877-4246-993f-d653f2abecb9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:53.388240 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bc3f7bb0-c877-4246-993f-d653f2abecb9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:53.388812 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bc3f7bb0-c877-4246-993f-d653f2abecb9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:53.596259 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-bc3f7bb0-c877-4246-993f-d653f2abecb9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:53.605156 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-bc3f7bb0-c877-4246-993f-d653f2abecb9 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1555 microversion: 2.1 time: 0.238864 Oct 06 12:30:53.608157 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 484/962] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:53 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1555 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:54.631313 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9099171d-98af-4b3e-84af-fbae244a75b0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:54.635197 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9099171d-98af-4b3e-84af-fbae244a75b0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:54.643340 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9099171d-98af-4b3e-84af-fbae244a75b0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:54.644116 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9099171d-98af-4b3e-84af-fbae244a75b0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:54.644750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9099171d-98af-4b3e-84af-fbae244a75b0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:54.645893 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9099171d-98af-4b3e-84af-fbae244a75b0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:54.646548 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9099171d-98af-4b3e-84af-fbae244a75b0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:54.647057 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9099171d-98af-4b3e-84af-fbae244a75b0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:54.795106 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9099171d-98af-4b3e-84af-fbae244a75b0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:54.804796 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9099171d-98af-4b3e-84af-fbae244a75b0 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1555 microversion: 2.1 time: 0.178162 Oct 06 12:30:54.805439 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 479/963] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:54 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:55.830917 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-758da449-fcb5-4b85-b735-e14994ac2e84 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:55.832092 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-758da449-fcb5-4b85-b735-e14994ac2e84 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:55.840007 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-758da449-fcb5-4b85-b735-e14994ac2e84 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:55.840803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-758da449-fcb5-4b85-b735-e14994ac2e84 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:55.843393 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-758da449-fcb5-4b85-b735-e14994ac2e84 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:55.844431 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-758da449-fcb5-4b85-b735-e14994ac2e84 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:55.844987 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-758da449-fcb5-4b85-b735-e14994ac2e84 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:55.845511 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-758da449-fcb5-4b85-b735-e14994ac2e84 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:56.072889 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-758da449-fcb5-4b85-b735-e14994ac2e84 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:56.083584 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-758da449-fcb5-4b85-b735-e14994ac2e84 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1555 microversion: 2.1 time: 0.257873 Oct 06 12:30:56.088563 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 485/964] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:55 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1555 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:56.522339 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-c46a5b41-d498-4792-b802-2664ad81f386 req-c52c1b96-e5a8-498b-bc99-772c9066eb34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb42d057-804d-4d87-953a-953bf69fe126", "name": "network-vif-deleted", "tag": "9a4b9943-b074-4a4d-a9c2-a11438741a56"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:30:56.539793 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-c46a5b41-d498-4792-b802-2664ad81f386 req-c52c1b96-e5a8-498b-bc99-772c9066eb34 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:56.540261 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-c46a5b41-d498-4792-b802-2664ad81f386 req-c52c1b96-e5a8-498b-bc99-772c9066eb34 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:56.540692 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-c46a5b41-d498-4792-b802-2664ad81f386 req-c52c1b96-e5a8-498b-bc99-772c9066eb34 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:56.572368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-c46a5b41-d498-4792-b802-2664ad81f386 req-c52c1b96-e5a8-498b-bc99-772c9066eb34 service nova] Creating event network-vif-deleted:9a4b9943-b074-4a4d-a9c2-a11438741a56 for instance eb42d057-804d-4d87-953a-953bf69fe126 on hv-cinder-85604 Oct 06 12:30:56.578699 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-c46a5b41-d498-4792-b802-2664ad81f386 req-c52c1b96-e5a8-498b-bc99-772c9066eb34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060256 Oct 06 12:30:56.587300 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 480/965] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:30:57.110378 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1729f9c7-800a-4ced-a026-8c0e8ced22c1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:57.110992 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-1729f9c7-800a-4ced-a026-8c0e8ced22c1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:57.120975 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1729f9c7-800a-4ced-a026-8c0e8ced22c1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:57.121555 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1729f9c7-800a-4ced-a026-8c0e8ced22c1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:57.122205 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1729f9c7-800a-4ced-a026-8c0e8ced22c1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:57.123169 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1729f9c7-800a-4ced-a026-8c0e8ced22c1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:57.123673 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1729f9c7-800a-4ced-a026-8c0e8ced22c1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:57.124109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1729f9c7-800a-4ced-a026-8c0e8ced22c1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:57.145198 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=100 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:57.159799 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1729f9c7-800a-4ced-a026-8c0e8ced22c1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:57.160772 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1729f9c7-800a-4ced-a026-8c0e8ced22c1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:57.161387 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1729f9c7-800a-4ced-a026-8c0e8ced22c1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:57.161841 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-1729f9c7-800a-4ced-a026-8c0e8ced22c1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lazy-loading 'fault' on Instance uuid eb42d057-804d-4d87-953a-953bf69fe126 {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:30:57.208554 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-1729f9c7-800a-4ced-a026-8c0e8ced22c1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196f71447aaf45fd812efb9eeba2c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c822fb7252b4804aa9a0cb228b6397c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:30:57.218941 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-1729f9c7-800a-4ced-a026-8c0e8ced22c1 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 200 len: 1349 microversion: 2.1 time: 0.112311 Oct 06 12:30:57.219763 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 486/966] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:57 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 1349 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:30:58.244269 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a721322a-534b-464a-b538-2ef7279276ac tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:58.246109 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a721322a-534b-464a-b538-2ef7279276ac tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] [instance: eb42d057-804d-4d87-953a-953bf69fe126] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:30:58.254437 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a721322a-534b-464a-b538-2ef7279276ac tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:58.255115 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a721322a-534b-464a-b538-2ef7279276ac tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:58.255873 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a721322a-534b-464a-b538-2ef7279276ac tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:58.257723 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a721322a-534b-464a-b538-2ef7279276ac tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:30:58.258815 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a721322a-534b-464a-b538-2ef7279276ac tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:30:58.259249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a721322a-534b-464a-b538-2ef7279276ac tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:30:58.275122 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-a721322a-534b-464a-b538-2ef7279276ac tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] HTTP exception thrown: Instance eb42d057-804d-4d87-953a-953bf69fe126 could not be found. Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a721322a-534b-464a-b538-2ef7279276ac tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Request method failure captured: Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 HTTP/1.1 Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPskyqGXA6t40xYJjGKtwF3n68OJdWVUjbgBIcLcOMzYrqLL8pissJkwJqYP-dcQNah9le49D7pK0t-r311W0SrSUMiScuXJt7miyZvEo1sX_HDupysK8f5thr-cJDN4NiM4v2K8AAhEhuQp8ZnSBNVnnBdgCpLLHrscNCuSa135zS1Q Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 1c822fb7252b4804aa9a0cb228b6397c Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-TestMinimumBasicScenario-502112929 Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:30:58.279618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:30:58.281255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c822fb7252b4804aa9a0cb228b6397c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1c822fb7252b4804aa9a0cb228b6397c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c822fb7252b4804aa9a0cb228b6397c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1c822fb7252b4804aa9a0cb228b6397c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:30:58.281255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-TestMinimumBasicScenario-502112929 Oct 06 12:30:58.281255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 1c822fb7252b4804aa9a0cb228b6397c Oct 06 12:30:58.281255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-TestMinimumBasicScenario-502112929 Oct 06 12:30:58.281255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-TestMinimumBasicScenario-502112929-project Oct 06 12:30:58.281255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:30:58.281255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:30:58.281255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 196f71447aaf45fd812efb9eeba2c0cb Oct 06 12:30:58.281255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-TestMinimumBasicScenario-502112929-project Oct 06 12:30:58.281255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:30:58.281255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance eb42d057-804d-4d87-953a-953bf69fe126 could not be found. Oct 06 12:30:58.281255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': 'eb42d057-804d-4d87-953a-953bf69fe126'} Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb42d057-804d-4d87-953a-953bf69fe126 could not be found. Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:30:58.282287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb42d057-804d-4d87-953a-953bf69fe126 could not be found. Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb42d057-804d-4d87-953a-953bf69fe126 could not be found. Oct 06 12:30:58.284217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:30:58.286608 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a721322a-534b-464a-b538-2ef7279276ac tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Returning 404 to user: Instance eb42d057-804d-4d87-953a-953bf69fe126 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:30:58.286608 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a721322a-534b-464a-b538-2ef7279276ac tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126" status: 404 len: 111 microversion: 2.1 time: 0.042919 Oct 06 12:30:58.286608 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 481/967] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:30:58 2022] GET /compute/v2.1/servers/eb42d057-804d-4d87-953a-953bf69fe126 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:30:58.290846 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-257e0040-6b69-4ee0-9737-f635691a9d62 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] Calling method '.version_select at 0x7f03ae304160>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:30:58.314124 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-257e0040-6b69-4ee0-9737-f635691a9d62 tempest-TestMinimumBasicScenario-502112929 tempest-TestMinimumBasicScenario-502112929-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1455950167" status: 202 len: 0 microversion: 2.1 time: 0.027589 Oct 06 12:30:58.315121 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 487/968] 10.222.0.33 () {58 vars in 1272 bytes} [Thu Oct 6 12:30:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1455950167 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:32:10.663098 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:10.663882 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:10.668883 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-374b4458-6757-4a54-b721-1bf196f03297 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:10.669369 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-374b4458-6757-4a54-b721-1bf196f03297 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:10.677847 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-374b4458-6757-4a54-b721-1bf196f03297 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:10.678329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-374b4458-6757-4a54-b721-1bf196f03297 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:10.679079 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-374b4458-6757-4a54-b721-1bf196f03297 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:10.679820 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-374b4458-6757-4a54-b721-1bf196f03297 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:10.680271 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-374b4458-6757-4a54-b721-1bf196f03297 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:10.680690 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-374b4458-6757-4a54-b721-1bf196f03297 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:10.705543 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-374b4458-6757-4a54-b721-1bf196f03297 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/ips" status: 200 len: 147 microversion: 2.1 time: 0.044589 Oct 06 12:32:10.706104 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 482/969] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 12:32:10 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/ips => generated 147 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:32:12.044694 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=4 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:12.045531 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:12.050496 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-76fd1703-eafb-4251-b066-fddde8bf0133 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5efed6b1-2588-4288-9c8a-776b8c0e82cd"}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:32:12.052818 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-76fd1703-eafb-4251-b066-fddde8bf0133 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:12.061081 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-76fd1703-eafb-4251-b066-fddde8bf0133 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:12.061573 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-76fd1703-eafb-4251-b066-fddde8bf0133 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:12.062007 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-76fd1703-eafb-4251-b066-fddde8bf0133 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:12.062695 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-76fd1703-eafb-4251-b066-fddde8bf0133 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:12.063153 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-76fd1703-eafb-4251-b066-fddde8bf0133 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:12.063610 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-76fd1703-eafb-4251-b066-fddde8bf0133 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:12.331630 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-76fd1703-eafb-4251-b066-fddde8bf0133 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "POST /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288697 Oct 06 12:32:12.332280 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 488/970] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 12:32:12 2022] POST /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:32:19.857470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d3a5f6f1-e55f-4811-a7e3-71e29d9b8791 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:19.859682 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d3a5f6f1-e55f-4811-a7e3-71e29d9b8791 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:19.866339 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d3a5f6f1-e55f-4811-a7e3-71e29d9b8791 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:19.866822 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d3a5f6f1-e55f-4811-a7e3-71e29d9b8791 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:19.867252 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d3a5f6f1-e55f-4811-a7e3-71e29d9b8791 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:19.867964 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d3a5f6f1-e55f-4811-a7e3-71e29d9b8791 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:19.868418 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d3a5f6f1-e55f-4811-a7e3-71e29d9b8791 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:19.868840 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d3a5f6f1-e55f-4811-a7e3-71e29d9b8791 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:19.897541 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d3a5f6f1-e55f-4811-a7e3-71e29d9b8791 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044063 Oct 06 12:32:19.898080 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 483/971] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:32:19 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:32:19.910061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a1c88a67-9dfd-4e7f-a383-401503094579 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:19.910650 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a1c88a67-9dfd-4e7f-a383-401503094579 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:19.917208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a1c88a67-9dfd-4e7f-a383-401503094579 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:19.917695 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a1c88a67-9dfd-4e7f-a383-401503094579 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:19.918132 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a1c88a67-9dfd-4e7f-a383-401503094579 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:19.918827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a1c88a67-9dfd-4e7f-a383-401503094579 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:19.919287 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a1c88a67-9dfd-4e7f-a383-401503094579 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:19.919743 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a1c88a67-9dfd-4e7f-a383-401503094579 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:19.947657 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a1c88a67-9dfd-4e7f-a383-401503094579 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments/5efed6b1-2588-4288-9c8a-776b8c0e82cd" status: 200 len: 194 microversion: 2.1 time: 0.041419 Oct 06 12:32:19.948231 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 489/972] 10.222.0.33 () {58 vars in 1413 bytes} [Thu Oct 6 12:32:19 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments/5efed6b1-2588-4288-9c8a-776b8c0e82cd => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:32:21.270094 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e9ecd284-9533-4cd4-a6fe-18c558360ed8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b2fb815-33af-4fd3-8949-635e9dce465b"}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:32:21.272405 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e9ecd284-9533-4cd4-a6fe-18c558360ed8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:21.279004 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e9ecd284-9533-4cd4-a6fe-18c558360ed8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:21.279486 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e9ecd284-9533-4cd4-a6fe-18c558360ed8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:21.279946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e9ecd284-9533-4cd4-a6fe-18c558360ed8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:21.280622 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e9ecd284-9533-4cd4-a6fe-18c558360ed8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:21.281070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e9ecd284-9533-4cd4-a6fe-18c558360ed8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:21.281493 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e9ecd284-9533-4cd4-a6fe-18c558360ed8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:21.545366 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e9ecd284-9533-4cd4-a6fe-18c558360ed8 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "POST /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279083 Oct 06 12:32:21.545968 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 484/973] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 12:32:21 2022] POST /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:32:22.734791 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7bb76d86-caef-45d0-8e07-bcf488f015fb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:22.735357 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7bb76d86-caef-45d0-8e07-bcf488f015fb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:22.741852 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7bb76d86-caef-45d0-8e07-bcf488f015fb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:22.742408 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7bb76d86-caef-45d0-8e07-bcf488f015fb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:22.742850 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7bb76d86-caef-45d0-8e07-bcf488f015fb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:22.743583 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7bb76d86-caef-45d0-8e07-bcf488f015fb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:22.744061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7bb76d86-caef-45d0-8e07-bcf488f015fb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:22.744481 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7bb76d86-caef-45d0-8e07-bcf488f015fb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:22.767531 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7bb76d86-caef-45d0-8e07-bcf488f015fb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34/ips" status: 200 len: 150 microversion: 2.20 time: 0.036706 Oct 06 12:32:22.768102 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 490/974] 10.222.0.33 () {60 vars in 1289 bytes} [Thu Oct 6 12:32:22 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:32:24.548193 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0825ef6d-0594-4685-b366-8910defedccb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:32:24.548823 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0825ef6d-0594-4685-b366-8910defedccb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:24.554901 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0825ef6d-0594-4685-b366-8910defedccb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:24.555390 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0825ef6d-0594-4685-b366-8910defedccb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:24.555861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0825ef6d-0594-4685-b366-8910defedccb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:24.556554 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0825ef6d-0594-4685-b366-8910defedccb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:24.557647 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0825ef6d-0594-4685-b366-8910defedccb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:24.558079 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0825ef6d-0594-4685-b366-8910defedccb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:24.580048 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-0825ef6d-0594-4685-b366-8910defedccb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lazy-loading 'flavor' on Instance uuid c743b80a-43e9-4dc1-a570-6873a5992f34 {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:32:24.959496 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0825ef6d-0594-4685-b366-8910defedccb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "POST /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34/action" status: 202 len: 0 microversion: 2.20 time: 0.415873 Oct 06 12:32:24.960223 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 485/975] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Oct 6 12:32:24 2022] POST /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:32:24.968486 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-25443f4e-f750-4bcf-abdb-37f15374a99e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:24.969229 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-25443f4e-f750-4bcf-abdb-37f15374a99e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:24.975836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-25443f4e-f750-4bcf-abdb-37f15374a99e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:24.976306 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-25443f4e-f750-4bcf-abdb-37f15374a99e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:24.976759 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-25443f4e-f750-4bcf-abdb-37f15374a99e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:24.977456 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-25443f4e-f750-4bcf-abdb-37f15374a99e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:24.977909 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-25443f4e-f750-4bcf-abdb-37f15374a99e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:24.978340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-25443f4e-f750-4bcf-abdb-37f15374a99e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:25.206227 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-25443f4e-f750-4bcf-abdb-37f15374a99e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:25.214313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-25443f4e-f750-4bcf-abdb-37f15374a99e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:25.215791 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-25443f4e-f750-4bcf-abdb-37f15374a99e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:25.216977 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-25443f4e-f750-4bcf-abdb-37f15374a99e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.252453 Oct 06 12:32:25.217525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 491/976] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:24 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:32:26.243992 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-44922349-cf28-4a69-84da-b4ad3ca728e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:26.245216 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-44922349-cf28-4a69-84da-b4ad3ca728e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:26.252228 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-44922349-cf28-4a69-84da-b4ad3ca728e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:26.252708 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-44922349-cf28-4a69-84da-b4ad3ca728e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:26.253135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-44922349-cf28-4a69-84da-b4ad3ca728e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:26.253821 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-44922349-cf28-4a69-84da-b4ad3ca728e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:26.254269 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-44922349-cf28-4a69-84da-b4ad3ca728e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:26.254688 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-44922349-cf28-4a69-84da-b4ad3ca728e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:26.383488 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-44922349-cf28-4a69-84da-b4ad3ca728e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:26.391543 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-44922349-cf28-4a69-84da-b4ad3ca728e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:26.392972 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-44922349-cf28-4a69-84da-b4ad3ca728e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:26.394103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-44922349-cf28-4a69-84da-b4ad3ca728e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.154841 Oct 06 12:32:26.394669 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 486/977] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:26 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:27.419662 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-91c11a54-fbe3-4756-b422-98259d136462 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:27.420195 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-91c11a54-fbe3-4756-b422-98259d136462 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:27.426657 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-91c11a54-fbe3-4756-b422-98259d136462 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:27.427140 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-91c11a54-fbe3-4756-b422-98259d136462 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:27.427603 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-91c11a54-fbe3-4756-b422-98259d136462 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:27.428284 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-91c11a54-fbe3-4756-b422-98259d136462 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:27.428736 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-91c11a54-fbe3-4756-b422-98259d136462 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:27.429161 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-91c11a54-fbe3-4756-b422-98259d136462 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:27.552674 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-91c11a54-fbe3-4756-b422-98259d136462 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:27.561347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-91c11a54-fbe3-4756-b422-98259d136462 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:27.562780 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-91c11a54-fbe3-4756-b422-98259d136462 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:27.563961 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-91c11a54-fbe3-4756-b422-98259d136462 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.148302 Oct 06 12:32:27.564521 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 492/978] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:27 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:28.588975 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-1fa26c9e-43cb-43a0-b65b-321cec0a3a62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:28.589515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-1fa26c9e-43cb-43a0-b65b-321cec0a3a62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:28.595773 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1fa26c9e-43cb-43a0-b65b-321cec0a3a62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:28.596253 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1fa26c9e-43cb-43a0-b65b-321cec0a3a62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:28.596679 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1fa26c9e-43cb-43a0-b65b-321cec0a3a62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:28.597351 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1fa26c9e-43cb-43a0-b65b-321cec0a3a62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:28.597796 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1fa26c9e-43cb-43a0-b65b-321cec0a3a62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:28.598219 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1fa26c9e-43cb-43a0-b65b-321cec0a3a62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:28.741148 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-1fa26c9e-43cb-43a0-b65b-321cec0a3a62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:28.749422 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-1fa26c9e-43cb-43a0-b65b-321cec0a3a62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:28.751055 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-1fa26c9e-43cb-43a0-b65b-321cec0a3a62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:28.752237 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-1fa26c9e-43cb-43a0-b65b-321cec0a3a62 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.167365 Oct 06 12:32:28.752823 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 487/979] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:28 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:29.083796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-81e408a7-410b-4808-8888-c9858b97a114 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:29.086030 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-81e408a7-410b-4808-8888-c9858b97a114 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:29.092706 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-81e408a7-410b-4808-8888-c9858b97a114 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:29.093189 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-81e408a7-410b-4808-8888-c9858b97a114 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:29.093665 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-81e408a7-410b-4808-8888-c9858b97a114 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:29.094348 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-81e408a7-410b-4808-8888-c9858b97a114 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:29.094807 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-81e408a7-410b-4808-8888-c9858b97a114 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:29.095228 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-81e408a7-410b-4808-8888-c9858b97a114 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:29.126553 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-81e408a7-410b-4808-8888-c9858b97a114 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046750 Oct 06 12:32:29.127101 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 493/980] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:32:29 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:32:29.267344 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c9acbdd9-4e31-417d-b4a2-d1f13ee6dacb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:29.267877 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c9acbdd9-4e31-417d-b4a2-d1f13ee6dacb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:29.273790 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c9acbdd9-4e31-417d-b4a2-d1f13ee6dacb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:29.274556 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c9acbdd9-4e31-417d-b4a2-d1f13ee6dacb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:29.274997 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c9acbdd9-4e31-417d-b4a2-d1f13ee6dacb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:29.275722 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c9acbdd9-4e31-417d-b4a2-d1f13ee6dacb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:29.276181 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c9acbdd9-4e31-417d-b4a2-d1f13ee6dacb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:29.276608 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c9acbdd9-4e31-417d-b4a2-d1f13ee6dacb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:29.304553 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c9acbdd9-4e31-417d-b4a2-d1f13ee6dacb tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments/5efed6b1-2588-4288-9c8a-776b8c0e82cd" status: 200 len: 194 microversion: 2.1 time: 0.041164 Oct 06 12:32:29.305120 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 488/981] 10.222.0.33 () {58 vars in 1413 bytes} [Thu Oct 6 12:32:29 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments/5efed6b1-2588-4288-9c8a-776b8c0e82cd => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:32:29.315873 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f3c04520-ff49-4c83-9e85-85233153504a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:29.316364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f3c04520-ff49-4c83-9e85-85233153504a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:29.322086 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3c04520-ff49-4c83-9e85-85233153504a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:29.323281 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3c04520-ff49-4c83-9e85-85233153504a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:29.323745 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3c04520-ff49-4c83-9e85-85233153504a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:29.324425 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3c04520-ff49-4c83-9e85-85233153504a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:29.324876 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3c04520-ff49-4c83-9e85-85233153504a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:29.325296 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f3c04520-ff49-4c83-9e85-85233153504a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:29.410003 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-f3c04520-ff49-4c83-9e85-85233153504a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lazy-loading 'services' on Instance uuid 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:32:29.481093 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f3c04520-ff49-4c83-9e85-85233153504a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments/5efed6b1-2588-4288-9c8a-776b8c0e82cd" status: 202 len: 0 microversion: 2.1 time: 0.168920 Oct 06 12:32:29.481671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 494/982] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 12:32:29 2022] DELETE /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments/5efed6b1-2588-4288-9c8a-776b8c0e82cd => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:32:29.779144 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3ad9d7d4-3f59-4ed3-ba03-166015631c41 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:29.779721 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3ad9d7d4-3f59-4ed3-ba03-166015631c41 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:29.786019 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3ad9d7d4-3f59-4ed3-ba03-166015631c41 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:29.786499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3ad9d7d4-3f59-4ed3-ba03-166015631c41 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:29.786930 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3ad9d7d4-3f59-4ed3-ba03-166015631c41 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:29.787655 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3ad9d7d4-3f59-4ed3-ba03-166015631c41 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:29.788107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3ad9d7d4-3f59-4ed3-ba03-166015631c41 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:29.788529 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3ad9d7d4-3f59-4ed3-ba03-166015631c41 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:29.913101 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3ad9d7d4-3f59-4ed3-ba03-166015631c41 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:29.921731 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3ad9d7d4-3f59-4ed3-ba03-166015631c41 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:29.923174 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-3ad9d7d4-3f59-4ed3-ba03-166015631c41 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:29.924352 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3ad9d7d4-3f59-4ed3-ba03-166015631c41 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.149218 Oct 06 12:32:29.924913 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 489/983] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:29 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:30.951563 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-61e737b8-1779-4179-9d03-a14490466e2e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:30.952411 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-61e737b8-1779-4179-9d03-a14490466e2e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:30.958637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-61e737b8-1779-4179-9d03-a14490466e2e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:30.959236 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-61e737b8-1779-4179-9d03-a14490466e2e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:30.959712 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-61e737b8-1779-4179-9d03-a14490466e2e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:30.960457 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-61e737b8-1779-4179-9d03-a14490466e2e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:30.961027 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-61e737b8-1779-4179-9d03-a14490466e2e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:30.961485 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-61e737b8-1779-4179-9d03-a14490466e2e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:31.095275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-61e737b8-1779-4179-9d03-a14490466e2e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:31.104505 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-61e737b8-1779-4179-9d03-a14490466e2e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:31.105945 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-61e737b8-1779-4179-9d03-a14490466e2e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:31.107101 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-61e737b8-1779-4179-9d03-a14490466e2e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.161381 Oct 06 12:32:31.107718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 495/984] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:30 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:31.656636 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e7764eaf-5e74-46cb-b4bd-2ef4dfb1d89d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:31.657194 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e7764eaf-5e74-46cb-b4bd-2ef4dfb1d89d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:31.663590 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e7764eaf-5e74-46cb-b4bd-2ef4dfb1d89d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:31.664127 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e7764eaf-5e74-46cb-b4bd-2ef4dfb1d89d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:31.664549 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e7764eaf-5e74-46cb-b4bd-2ef4dfb1d89d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:31.665239 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e7764eaf-5e74-46cb-b4bd-2ef4dfb1d89d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:31.665694 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e7764eaf-5e74-46cb-b4bd-2ef4dfb1d89d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:31.666124 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e7764eaf-5e74-46cb-b4bd-2ef4dfb1d89d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:31.694574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e7764eaf-5e74-46cb-b4bd-2ef4dfb1d89d tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments/1b2fb815-33af-4fd3-8949-635e9dce465b" status: 200 len: 194 microversion: 2.1 time: 0.041840 Oct 06 12:32:31.695147 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 490/985] 10.222.0.33 () {58 vars in 1413 bytes} [Thu Oct 6 12:32:31 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments/1b2fb815-33af-4fd3-8949-635e9dce465b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:32:31.706220 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d933509f-dbbd-497c-924a-da22de694a92 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:31.706710 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d933509f-dbbd-497c-924a-da22de694a92 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:31.712476 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d933509f-dbbd-497c-924a-da22de694a92 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:31.712956 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d933509f-dbbd-497c-924a-da22de694a92 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:31.713386 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d933509f-dbbd-497c-924a-da22de694a92 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:31.714063 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d933509f-dbbd-497c-924a-da22de694a92 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:31.714517 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d933509f-dbbd-497c-924a-da22de694a92 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:31.714936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d933509f-dbbd-497c-924a-da22de694a92 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:31.795081 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-d933509f-dbbd-497c-924a-da22de694a92 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lazy-loading 'services' on Instance uuid 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:32:31.865352 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d933509f-dbbd-497c-924a-da22de694a92 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments/1b2fb815-33af-4fd3-8949-635e9dce465b" status: 202 len: 0 microversion: 2.1 time: 0.162786 Oct 06 12:32:31.865941 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 496/986] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 12:32:31 2022] DELETE /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments/1b2fb815-33af-4fd3-8949-635e9dce465b => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:32:32.132293 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2f87a5d7-8514-45bc-89fc-c2456bcec526 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:32.132831 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2f87a5d7-8514-45bc-89fc-c2456bcec526 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:32.139309 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f87a5d7-8514-45bc-89fc-c2456bcec526 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:32.139826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f87a5d7-8514-45bc-89fc-c2456bcec526 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:32.140263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f87a5d7-8514-45bc-89fc-c2456bcec526 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:32.140943 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f87a5d7-8514-45bc-89fc-c2456bcec526 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:32.141394 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f87a5d7-8514-45bc-89fc-c2456bcec526 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:32.141815 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f87a5d7-8514-45bc-89fc-c2456bcec526 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:32.265556 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2f87a5d7-8514-45bc-89fc-c2456bcec526 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:32.273575 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2f87a5d7-8514-45bc-89fc-c2456bcec526 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:32.275288 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2f87a5d7-8514-45bc-89fc-c2456bcec526 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:32.276962 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2f87a5d7-8514-45bc-89fc-c2456bcec526 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.148773 Oct 06 12:32:32.277520 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 491/987] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:32 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:33.039395 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6f668b3c-4b26-4b05-a0fb-e54cb391c9e3 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:33.042397 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-6f668b3c-4b26-4b05-a0fb-e54cb391c9e3 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:33.049138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f668b3c-4b26-4b05-a0fb-e54cb391c9e3 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:33.049632 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f668b3c-4b26-4b05-a0fb-e54cb391c9e3 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:33.050074 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f668b3c-4b26-4b05-a0fb-e54cb391c9e3 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:33.050771 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f668b3c-4b26-4b05-a0fb-e54cb391c9e3 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:33.051231 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f668b3c-4b26-4b05-a0fb-e54cb391c9e3 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:33.051699 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6f668b3c-4b26-4b05-a0fb-e54cb391c9e3 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:33.080718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-6f668b3c-4b26-4b05-a0fb-e54cb391c9e3 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045669 Oct 06 12:32:33.081282 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 497/988] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:32:33 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:32:33.195102 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-75476363-1c0b-4905-9cd0-9287064bc274 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:33.197275 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-75476363-1c0b-4905-9cd0-9287064bc274 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:33.204212 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-75476363-1c0b-4905-9cd0-9287064bc274 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:33.204695 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-75476363-1c0b-4905-9cd0-9287064bc274 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:33.205130 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-75476363-1c0b-4905-9cd0-9287064bc274 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:33.205820 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-75476363-1c0b-4905-9cd0-9287064bc274 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:33.206279 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-75476363-1c0b-4905-9cd0-9287064bc274 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:33.206706 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-75476363-1c0b-4905-9cd0-9287064bc274 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:33.235348 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-75476363-1c0b-4905-9cd0-9287064bc274 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044177 Oct 06 12:32:33.235936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 492/989] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:32:33 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:32:33.298097 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-58f32aba-fac8-4e38-8228-09ee8dcf806a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:33.298586 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-58f32aba-fac8-4e38-8228-09ee8dcf806a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:33.301856 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-88bb3e0d-0223-4f39-abe0-5027efe8a608 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:33.302469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-88bb3e0d-0223-4f39-abe0-5027efe8a608 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:33.304400 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-58f32aba-fac8-4e38-8228-09ee8dcf806a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:33.304884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-58f32aba-fac8-4e38-8228-09ee8dcf806a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:33.305314 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-58f32aba-fac8-4e38-8228-09ee8dcf806a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:33.305997 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-58f32aba-fac8-4e38-8228-09ee8dcf806a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:33.306449 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-58f32aba-fac8-4e38-8228-09ee8dcf806a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:33.306947 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-58f32aba-fac8-4e38-8228-09ee8dcf806a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:33.308924 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88bb3e0d-0223-4f39-abe0-5027efe8a608 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:33.309411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88bb3e0d-0223-4f39-abe0-5027efe8a608 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:33.309847 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88bb3e0d-0223-4f39-abe0-5027efe8a608 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:33.310541 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88bb3e0d-0223-4f39-abe0-5027efe8a608 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:33.311009 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88bb3e0d-0223-4f39-abe0-5027efe8a608 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:33.311428 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88bb3e0d-0223-4f39-abe0-5027efe8a608 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:33.331802 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-58f32aba-fac8-4e38-8228-09ee8dcf806a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Going to try to terminate instance {{(pid=120508) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:32:33.405296 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-58f32aba-fac8-4e38-8228-09ee8dcf806a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 204 len: 0 microversion: 2.1 time: 0.110722 Oct 06 12:32:33.405901 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 498/990] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:32:33 2022] DELETE /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:32:33.417145 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2ab3c3c3-55b1-41cc-91a6-0da57816e424 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:33.417849 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2ab3c3c3-55b1-41cc-91a6-0da57816e424 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:33.423768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2ab3c3c3-55b1-41cc-91a6-0da57816e424 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:33.424252 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2ab3c3c3-55b1-41cc-91a6-0da57816e424 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:33.424687 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2ab3c3c3-55b1-41cc-91a6-0da57816e424 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:33.425382 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2ab3c3c3-55b1-41cc-91a6-0da57816e424 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:33.425835 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2ab3c3c3-55b1-41cc-91a6-0da57816e424 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:33.426254 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2ab3c3c3-55b1-41cc-91a6-0da57816e424 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:33.450510 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-88bb3e0d-0223-4f39-abe0-5027efe8a608 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:33.458717 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-88bb3e0d-0223-4f39-abe0-5027efe8a608 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:33.460207 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-88bb3e0d-0223-4f39-abe0-5027efe8a608 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:33.461351 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-88bb3e0d-0223-4f39-abe0-5027efe8a608 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.163344 Oct 06 12:32:33.461912 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 493/991] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:33 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:32:33.556123 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2ab3c3c3-55b1-41cc-91a6-0da57816e424 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:33.564235 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2ab3c3c3-55b1-41cc-91a6-0da57816e424 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1675 microversion: 2.1 time: 0.153521 Oct 06 12:32:33.564801 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 499/992] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:32:33 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:32:34.486112 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c31b1e0b-3655-4bed-a392-e535d6c40b00 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:34.486719 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c31b1e0b-3655-4bed-a392-e535d6c40b00 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:34.493014 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c31b1e0b-3655-4bed-a392-e535d6c40b00 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:34.493495 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c31b1e0b-3655-4bed-a392-e535d6c40b00 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:34.493927 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c31b1e0b-3655-4bed-a392-e535d6c40b00 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:34.494690 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c31b1e0b-3655-4bed-a392-e535d6c40b00 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:34.495087 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c31b1e0b-3655-4bed-a392-e535d6c40b00 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:34.495586 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c31b1e0b-3655-4bed-a392-e535d6c40b00 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:34.587669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f8b8b465-74d3-475c-a2ce-47613c5f749a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:34.588827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f8b8b465-74d3-475c-a2ce-47613c5f749a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:34.595001 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8b8b465-74d3-475c-a2ce-47613c5f749a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:34.595490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8b8b465-74d3-475c-a2ce-47613c5f749a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:34.596313 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8b8b465-74d3-475c-a2ce-47613c5f749a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:34.597008 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8b8b465-74d3-475c-a2ce-47613c5f749a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:34.597466 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8b8b465-74d3-475c-a2ce-47613c5f749a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:34.597889 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f8b8b465-74d3-475c-a2ce-47613c5f749a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:34.617437 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:34.620700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c31b1e0b-3655-4bed-a392-e535d6c40b00 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:34.629104 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c31b1e0b-3655-4bed-a392-e535d6c40b00 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:34.630534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c31b1e0b-3655-4bed-a392-e535d6c40b00 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:34.631729 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c31b1e0b-3655-4bed-a392-e535d6c40b00 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.149498 Oct 06 12:32:34.632572 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 494/993] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:34 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:34.730865 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f8b8b465-74d3-475c-a2ce-47613c5f749a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:34.738570 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f8b8b465-74d3-475c-a2ce-47613c5f749a tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1675 microversion: 2.1 time: 0.154744 Oct 06 12:32:34.739140 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 500/994] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:32:34 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:32:35.657055 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7d1f0865-5132-4d59-92ee-fe79f99cc336 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:35.657664 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7d1f0865-5132-4d59-92ee-fe79f99cc336 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:35.663955 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d1f0865-5132-4d59-92ee-fe79f99cc336 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:35.664439 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d1f0865-5132-4d59-92ee-fe79f99cc336 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:35.664874 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d1f0865-5132-4d59-92ee-fe79f99cc336 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:35.665591 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d1f0865-5132-4d59-92ee-fe79f99cc336 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:35.666044 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d1f0865-5132-4d59-92ee-fe79f99cc336 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:35.666957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7d1f0865-5132-4d59-92ee-fe79f99cc336 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:35.686510 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:35.760826 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9ce1ff14-945e-4458-ad6f-47f97f8744a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:35.761467 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9ce1ff14-945e-4458-ad6f-47f97f8744a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:35.767815 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ce1ff14-945e-4458-ad6f-47f97f8744a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:35.768303 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ce1ff14-945e-4458-ad6f-47f97f8744a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:35.768740 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ce1ff14-945e-4458-ad6f-47f97f8744a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:35.769433 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ce1ff14-945e-4458-ad6f-47f97f8744a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:35.769890 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ce1ff14-945e-4458-ad6f-47f97f8744a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:35.770322 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ce1ff14-945e-4458-ad6f-47f97f8744a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:35.926843 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7d1f0865-5132-4d59-92ee-fe79f99cc336 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:35.934975 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7d1f0865-5132-4d59-92ee-fe79f99cc336 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:35.936459 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7d1f0865-5132-4d59-92ee-fe79f99cc336 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:35.937624 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7d1f0865-5132-4d59-92ee-fe79f99cc336 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.284462 Oct 06 12:32:35.938382 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 495/995] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:35 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:36.023895 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9ce1ff14-945e-4458-ad6f-47f97f8744a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:36.032316 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9ce1ff14-945e-4458-ad6f-47f97f8744a7 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1675 microversion: 2.1 time: 0.275382 Oct 06 12:32:36.032884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 501/996] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:32:35 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1675 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:32:36.499036 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-b1680e49-ee64-4729-966c-c6e3cca541a1 req-5e0ad6a9-2b55-4947-92b0-0c5023c1abd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c71fe8d-fb4e-4848-9b99-318ccbb0ba14", "name": "network-vif-deleted", "tag": "abc2aa64-ae2d-47b6-9296-fa6c134455a2"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:32:36.508361 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-b1680e49-ee64-4729-966c-c6e3cca541a1 req-5e0ad6a9-2b55-4947-92b0-0c5023c1abd3 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:36.508833 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-b1680e49-ee64-4729-966c-c6e3cca541a1 req-5e0ad6a9-2b55-4947-92b0-0c5023c1abd3 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:36.509252 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-b1680e49-ee64-4729-966c-c6e3cca541a1 req-5e0ad6a9-2b55-4947-92b0-0c5023c1abd3 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:36.524127 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-b1680e49-ee64-4729-966c-c6e3cca541a1 req-5e0ad6a9-2b55-4947-92b0-0c5023c1abd3 service nova] Creating event network-vif-deleted:abc2aa64-ae2d-47b6-9296-fa6c134455a2 for instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 on hv-cinder-85604 Oct 06 12:32:36.530449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-b1680e49-ee64-4729-966c-c6e3cca541a1 req-5e0ad6a9-2b55-4947-92b0-0c5023c1abd3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035175 Oct 06 12:32:36.531054 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 496/997] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:32:36.962505 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c6cc0dbc-146b-47cc-b851-81072e590a49 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:36.963054 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c6cc0dbc-146b-47cc-b851-81072e590a49 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:36.970275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6cc0dbc-146b-47cc-b851-81072e590a49 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:36.970773 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6cc0dbc-146b-47cc-b851-81072e590a49 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:36.971211 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6cc0dbc-146b-47cc-b851-81072e590a49 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:36.971938 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6cc0dbc-146b-47cc-b851-81072e590a49 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:36.972401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6cc0dbc-146b-47cc-b851-81072e590a49 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:36.972832 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6cc0dbc-146b-47cc-b851-81072e590a49 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:37.056708 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c5670e5d-e4c6-4e3d-b3bb-35181d399724 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:37.057442 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c5670e5d-e4c6-4e3d-b3bb-35181d399724 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:37.065404 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c5670e5d-e4c6-4e3d-b3bb-35181d399724 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:37.067425 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c5670e5d-e4c6-4e3d-b3bb-35181d399724 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:37.068291 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c5670e5d-e4c6-4e3d-b3bb-35181d399724 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:37.069221 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c5670e5d-e4c6-4e3d-b3bb-35181d399724 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:37.069866 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c5670e5d-e4c6-4e3d-b3bb-35181d399724 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:37.070475 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c5670e5d-e4c6-4e3d-b3bb-35181d399724 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:37.114648 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c5670e5d-e4c6-4e3d-b3bb-35181d399724 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:37.115436 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c5670e5d-e4c6-4e3d-b3bb-35181d399724 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:37.116120 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c5670e5d-e4c6-4e3d-b3bb-35181d399724 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:37.117049 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-c5670e5d-e4c6-4e3d-b3bb-35181d399724 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lazy-loading 'fault' on Instance uuid 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:32:37.123876 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c6cc0dbc-146b-47cc-b851-81072e590a49 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:37.133165 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c6cc0dbc-146b-47cc-b851-81072e590a49 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:37.134668 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c6cc0dbc-146b-47cc-b851-81072e590a49 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:37.143185 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c6cc0dbc-146b-47cc-b851-81072e590a49 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.184736 Oct 06 12:32:37.144146 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 502/998] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:36 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:37.175191 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c5670e5d-e4c6-4e3d-b3bb-35181d399724 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066c1c9c79942c289b733d886d9fd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828d3459cdd641d98772383edfe3268f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:37.183661 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c5670e5d-e4c6-4e3d-b3bb-35181d399724 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 200 len: 1327 microversion: 2.1 time: 0.131785 Oct 06 12:32:37.184515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 497/999] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:32:37 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 1327 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:32:38.171352 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-21be2f86-6391-4d2a-b5af-bf4a1491e1e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:38.172000 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-21be2f86-6391-4d2a-b5af-bf4a1491e1e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:38.178394 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-21be2f86-6391-4d2a-b5af-bf4a1491e1e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:38.178881 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-21be2f86-6391-4d2a-b5af-bf4a1491e1e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:38.179316 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-21be2f86-6391-4d2a-b5af-bf4a1491e1e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:38.180035 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-21be2f86-6391-4d2a-b5af-bf4a1491e1e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:38.180493 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-21be2f86-6391-4d2a-b5af-bf4a1491e1e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:38.180918 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-21be2f86-6391-4d2a-b5af-bf4a1491e1e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:38.207604 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-43a7a45a-e9e1-4a2e-9b60-687d91dd0c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:38.208212 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-43a7a45a-e9e1-4a2e-9b60-687d91dd0c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:38.214775 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-43a7a45a-e9e1-4a2e-9b60-687d91dd0c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:38.215259 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-43a7a45a-e9e1-4a2e-9b60-687d91dd0c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:38.215715 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-43a7a45a-e9e1-4a2e-9b60-687d91dd0c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:38.216400 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-43a7a45a-e9e1-4a2e-9b60-687d91dd0c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:38.216967 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-43a7a45a-e9e1-4a2e-9b60-687d91dd0c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:38.217390 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-43a7a45a-e9e1-4a2e-9b60-687d91dd0c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:38.230782 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-43a7a45a-e9e1-4a2e-9b60-687d91dd0c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] HTTP exception thrown: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-43a7a45a-e9e1-4a2e-9b60-687d91dd0c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Request method failure captured: Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 HTTP/1.1 Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsh-dA-onsGd0gQTmqItM4pMONWdRZo80FOc6mfr9pYSye5FqjXyW74rk89eNToiFIk1akbz2oKSdcVQ1-Zmp9C90P3NwZgB6ZJYdrcy4qyzVqrVlQkiV4r3YxDOAofq4A-zNG7UKLRqszPrg8bhUKYusJOEryUX42mDPPfup9MgiNY Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 828d3459cdd641d98772383edfe3268f Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:32:38.232463 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:32:38.233984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/828d3459cdd641d98772383edfe3268f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_828d3459cdd641d98772383edfe3268f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/828d3459cdd641d98772383edfe3268f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/828d3459cdd641d98772383edfe3268f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:32:38.233984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:32:38.233984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 828d3459cdd641d98772383edfe3268f Oct 06 12:32:38.233984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:32:38.233984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-AttachVolumeTestJSON-1894626907-project Oct 06 12:32:38.233984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:32:38.233984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:32:38.233984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 3066c1c9c79942c289b733d886d9fd0f Oct 06 12:32:38.233984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-AttachVolumeTestJSON-1894626907-project Oct 06 12:32:38.233984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:32:38.233984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. Oct 06 12:32:38.233984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '4c71fe8d-fb4e-4848-9b99-318ccbb0ba14'} Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:32:38.234949 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. Oct 06 12:32:38.236788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:32:38.238854 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-43a7a45a-e9e1-4a2e-9b60-687d91dd0c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Returning 404 to user: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:32:38.238854 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-43a7a45a-e9e1-4a2e-9b60-687d91dd0c71 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 404 len: 111 microversion: 2.1 time: 0.030162 Oct 06 12:32:38.238854 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 498/1000] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:32:38 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:32:38.242399 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7ce3396d-8f73-407f-95cf-54e472487dc5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '.version_select at 0x7f03aa60c8b0>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:38.263205 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7ce3396d-8f73-407f-95cf-54e472487dc5 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-644240746" status: 202 len: 0 microversion: 2.1 time: 0.024318 Oct 06 12:32:38.263810 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 499/1001] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Oct 6 12:32:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-644240746 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 12:32:38.312753 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-21be2f86-6391-4d2a-b5af-bf4a1491e1e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:38.321141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-21be2f86-6391-4d2a-b5af-bf4a1491e1e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:38.322671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-21be2f86-6391-4d2a-b5af-bf4a1491e1e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:38.324218 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-21be2f86-6391-4d2a-b5af-bf4a1491e1e2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.156592 Oct 06 12:32:38.324652 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 503/1002] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:38 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:39.350495 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4ac859e1-2378-4cfa-87cb-5011ae6d42c0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:39.351054 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4ac859e1-2378-4cfa-87cb-5011ae6d42c0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:39.358168 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ac859e1-2378-4cfa-87cb-5011ae6d42c0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:39.358647 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ac859e1-2378-4cfa-87cb-5011ae6d42c0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:39.359072 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ac859e1-2378-4cfa-87cb-5011ae6d42c0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:39.359852 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ac859e1-2378-4cfa-87cb-5011ae6d42c0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:39.360302 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ac859e1-2378-4cfa-87cb-5011ae6d42c0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:39.360721 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ac859e1-2378-4cfa-87cb-5011ae6d42c0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:39.491858 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4ac859e1-2378-4cfa-87cb-5011ae6d42c0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:39.500547 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4ac859e1-2378-4cfa-87cb-5011ae6d42c0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:39.501977 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4ac859e1-2378-4cfa-87cb-5011ae6d42c0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:39.503114 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4ac859e1-2378-4cfa-87cb-5011ae6d42c0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.157164 Oct 06 12:32:39.503701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 500/1003] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:39 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:40.529646 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b98a76af-5876-49f4-bf30-9441edcc6d1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:40.530183 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b98a76af-5876-49f4-bf30-9441edcc6d1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:40.536546 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b98a76af-5876-49f4-bf30-9441edcc6d1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:40.537027 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b98a76af-5876-49f4-bf30-9441edcc6d1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:40.537455 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b98a76af-5876-49f4-bf30-9441edcc6d1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:40.538141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b98a76af-5876-49f4-bf30-9441edcc6d1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:40.538593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b98a76af-5876-49f4-bf30-9441edcc6d1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:40.539018 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b98a76af-5876-49f4-bf30-9441edcc6d1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:40.666552 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b98a76af-5876-49f4-bf30-9441edcc6d1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:40.674701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b98a76af-5876-49f4-bf30-9441edcc6d1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:40.676202 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b98a76af-5876-49f4-bf30-9441edcc6d1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:40.677375 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b98a76af-5876-49f4-bf30-9441edcc6d1d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.152842 Oct 06 12:32:40.677945 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 504/1004] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:40 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:41.126961 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-01a6ff0d-fcf6-4363-8dc7-0d3a26f78f83 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:41.127445 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-01a6ff0d-fcf6-4363-8dc7-0d3a26f78f83 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:41.129891 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:41.134977 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-01a6ff0d-fcf6-4363-8dc7-0d3a26f78f83 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:41.135492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-01a6ff0d-fcf6-4363-8dc7-0d3a26f78f83 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:41.135988 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-01a6ff0d-fcf6-4363-8dc7-0d3a26f78f83 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:41.136672 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-01a6ff0d-fcf6-4363-8dc7-0d3a26f78f83 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:41.137127 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-01a6ff0d-fcf6-4363-8dc7-0d3a26f78f83 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:41.137552 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-01a6ff0d-fcf6-4363-8dc7-0d3a26f78f83 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:41.152275 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-01a6ff0d-fcf6-4363-8dc7-0d3a26f78f83 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] HTTP exception thrown: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-01a6ff0d-fcf6-4363-8dc7-0d3a26f78f83 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Request method failure captured: Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: DELETE /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 HTTP/1.1 Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsh-dA-onsGd0gQTmqItM4pMONWdRZo80FOc6mfr9pYSye5FqjXyW74rk89eNToiFIk1akbz2oKSdcVQ1-Zmp9C90P3NwZgB6ZJYdrcy4qyzVqrVlQkiV4r3YxDOAofq4A-zNG7UKLRqszPrg8bhUKYusJOEryUX42mDPPfup9MgiNY Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 828d3459cdd641d98772383edfe3268f Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:32:41.153794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:32:41.155470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/828d3459cdd641d98772383edfe3268f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_828d3459cdd641d98772383edfe3268f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/828d3459cdd641d98772383edfe3268f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/828d3459cdd641d98772383edfe3268f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:32:41.155470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:32:41.155470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 828d3459cdd641d98772383edfe3268f Oct 06 12:32:41.155470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:32:41.155470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-AttachVolumeTestJSON-1894626907-project Oct 06 12:32:41.155470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:32:41.155470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:32:41.155470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 3066c1c9c79942c289b733d886d9fd0f Oct 06 12:32:41.155470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-AttachVolumeTestJSON-1894626907-project Oct 06 12:32:41.155470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:32:41.155470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. Oct 06 12:32:41.155470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '4c71fe8d-fb4e-4848-9b99-318ccbb0ba14'} Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:32:41.156623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. Oct 06 12:32:41.158135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:32:41.159748 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-01a6ff0d-fcf6-4363-8dc7-0d3a26f78f83 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Returning 404 to user: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:32:41.159748 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-01a6ff0d-fcf6-4363-8dc7-0d3a26f78f83 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 404 len: 111 microversion: 2.1 time: 0.032082 Oct 06 12:32:41.159748 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 501/1005] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:32:41 2022] DELETE /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:32:41.163878 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-71913066-4f89-4a70-bab8-0ef1f842ec6b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:41.164502 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-71913066-4f89-4a70-bab8-0ef1f842ec6b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:41.170956 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-71913066-4f89-4a70-bab8-0ef1f842ec6b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:41.171445 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-71913066-4f89-4a70-bab8-0ef1f842ec6b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:41.171928 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-71913066-4f89-4a70-bab8-0ef1f842ec6b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:41.172620 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-71913066-4f89-4a70-bab8-0ef1f842ec6b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:41.173083 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-71913066-4f89-4a70-bab8-0ef1f842ec6b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:41.173541 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-71913066-4f89-4a70-bab8-0ef1f842ec6b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:41.187253 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-71913066-4f89-4a70-bab8-0ef1f842ec6b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] HTTP exception thrown: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-71913066-4f89-4a70-bab8-0ef1f842ec6b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Request method failure captured: Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 HTTP/1.1 Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPsh-dA-onsGd0gQTmqItM4pMONWdRZo80FOc6mfr9pYSye5FqjXyW74rk89eNToiFIk1akbz2oKSdcVQ1-Zmp9C90P3NwZgB6ZJYdrcy4qyzVqrVlQkiV4r3YxDOAofq4A-zNG7UKLRqszPrg8bhUKYusJOEryUX42mDPPfup9MgiNY Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: 828d3459cdd641d98772383edfe3268f Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:32:41.188920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:32:41.190518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/828d3459cdd641d98772383edfe3268f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_828d3459cdd641d98772383edfe3268f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/828d3459cdd641d98772383edfe3268f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/828d3459cdd641d98772383edfe3268f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:32:41.190518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:32:41.190518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: 828d3459cdd641d98772383edfe3268f Oct 06 12:32:41.190518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:32:41.190518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-AttachVolumeTestJSON-1894626907-project Oct 06 12:32:41.190518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:32:41.190518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:32:41.190518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 3066c1c9c79942c289b733d886d9fd0f Oct 06 12:32:41.190518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-AttachVolumeTestJSON-1894626907-project Oct 06 12:32:41.190518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:32:41.190518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. Oct 06 12:32:41.190518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '4c71fe8d-fb4e-4848-9b99-318ccbb0ba14'} Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:32:41.191595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. Oct 06 12:32:41.193100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:32:41.194514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-71913066-4f89-4a70-bab8-0ef1f842ec6b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Returning 404 to user: Instance 4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:32:41.194514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-71913066-4f89-4a70-bab8-0ef1f842ec6b tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14" status: 404 len: 111 microversion: 2.1 time: 0.030483 Oct 06 12:32:41.194514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 505/1006] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:32:41 2022] GET /compute/v2.1/servers/4c71fe8d-fb4e-4848-9b99-318ccbb0ba14 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:32:41.702589 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-404ad08b-444d-4b59-b242-01b4ea6f06dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:41.703188 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-404ad08b-444d-4b59-b242-01b4ea6f06dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:41.709195 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-404ad08b-444d-4b59-b242-01b4ea6f06dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:41.709675 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-404ad08b-444d-4b59-b242-01b4ea6f06dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:41.710108 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-404ad08b-444d-4b59-b242-01b4ea6f06dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:41.710790 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-404ad08b-444d-4b59-b242-01b4ea6f06dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:41.711239 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-404ad08b-444d-4b59-b242-01b4ea6f06dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:41.711701 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-404ad08b-444d-4b59-b242-01b4ea6f06dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:41.839479 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-404ad08b-444d-4b59-b242-01b4ea6f06dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:41.847420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-404ad08b-444d-4b59-b242-01b4ea6f06dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:41.848888 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-404ad08b-444d-4b59-b242-01b4ea6f06dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:41.850023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-404ad08b-444d-4b59-b242-01b4ea6f06dd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1743 microversion: 2.20 time: 0.151347 Oct 06 12:32:41.850574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 502/1007] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:41 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:42.328459 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1c6b5242-4dfe-425f-8836-a9da7953ba81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:42.328998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-1c6b5242-4dfe-425f-8836-a9da7953ba81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:42.331360 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:42.336728 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1c6b5242-4dfe-425f-8836-a9da7953ba81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:42.337218 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1c6b5242-4dfe-425f-8836-a9da7953ba81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:42.337658 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1c6b5242-4dfe-425f-8836-a9da7953ba81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:42.338907 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1c6b5242-4dfe-425f-8836-a9da7953ba81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:42.339369 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1c6b5242-4dfe-425f-8836-a9da7953ba81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:42.339841 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1c6b5242-4dfe-425f-8836-a9da7953ba81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:42.354586 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-1c6b5242-4dfe-425f-8836-a9da7953ba81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] HTTP exception thrown: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1c6b5242-4dfe-425f-8836-a9da7953ba81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Request method failure captured: Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: DELETE /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f HTTP/1.1 Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPsh-dA-onsGd0gQTmqItM4pMONWdRZo80FOc6mfr9pYSye5FqjXyW74rk89eNToiFIk1akbz2oKSdcVQ1-Zmp9C90P3NwZgB6ZJYdrcy4qyzVqrVlQkiV4r3YxDOAofq4A-zNG7UKLRqszPrg8bhUKYusJOEryUX42mDPPfup9MgiNY Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: 828d3459cdd641d98772383edfe3268f Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:32:42.356164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:32:42.357748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/828d3459cdd641d98772383edfe3268f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_828d3459cdd641d98772383edfe3268f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/828d3459cdd641d98772383edfe3268f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/828d3459cdd641d98772383edfe3268f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:32:42.357748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:32:42.357748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: 828d3459cdd641d98772383edfe3268f Oct 06 12:32:42.357748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:32:42.357748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-AttachVolumeTestJSON-1894626907-project Oct 06 12:32:42.357748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:32:42.357748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:32:42.357748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 3066c1c9c79942c289b733d886d9fd0f Oct 06 12:32:42.357748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-AttachVolumeTestJSON-1894626907-project Oct 06 12:32:42.357748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:32:42.357748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. Oct 06 12:32:42.357748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': 'b7c26e82-69b3-4ffa-97e2-7ca36b941c1f'} Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:32:42.358884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. Oct 06 12:32:42.360543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:32:42.362281 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1c6b5242-4dfe-425f-8836-a9da7953ba81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Returning 404 to user: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:32:42.362281 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-1c6b5242-4dfe-425f-8836-a9da7953ba81 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 404 len: 111 microversion: 2.1 time: 0.032949 Oct 06 12:32:42.362281 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 506/1008] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:32:42 2022] DELETE /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:32:42.365875 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-fbb38cf4-fb7a-4cff-9d5c-ebb819fc4414 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:42.366492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-fbb38cf4-fb7a-4cff-9d5c-ebb819fc4414 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] [instance: b7c26e82-69b3-4ffa-97e2-7ca36b941c1f] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:42.372873 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbb38cf4-fb7a-4cff-9d5c-ebb819fc4414 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:42.373352 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbb38cf4-fb7a-4cff-9d5c-ebb819fc4414 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:42.373788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbb38cf4-fb7a-4cff-9d5c-ebb819fc4414 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:42.374473 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbb38cf4-fb7a-4cff-9d5c-ebb819fc4414 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:42.374929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbb38cf4-fb7a-4cff-9d5c-ebb819fc4414 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:42.375355 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fbb38cf4-fb7a-4cff-9d5c-ebb819fc4414 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:42.388508 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-fbb38cf4-fb7a-4cff-9d5c-ebb819fc4414 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] HTTP exception thrown: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-fbb38cf4-fb7a-4cff-9d5c-ebb819fc4414 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Request method failure captured: Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f HTTP/1.1 Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsh-dA-onsGd0gQTmqItM4pMONWdRZo80FOc6mfr9pYSye5FqjXyW74rk89eNToiFIk1akbz2oKSdcVQ1-Zmp9C90P3NwZgB6ZJYdrcy4qyzVqrVlQkiV4r3YxDOAofq4A-zNG7UKLRqszPrg8bhUKYusJOEryUX42mDPPfup9MgiNY Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 828d3459cdd641d98772383edfe3268f Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:32:42.390035 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:32:42.391691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/828d3459cdd641d98772383edfe3268f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_828d3459cdd641d98772383edfe3268f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/828d3459cdd641d98772383edfe3268f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/828d3459cdd641d98772383edfe3268f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:32:42.391691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:32:42.391691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 828d3459cdd641d98772383edfe3268f Oct 06 12:32:42.391691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1894626907 Oct 06 12:32:42.391691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-AttachVolumeTestJSON-1894626907-project Oct 06 12:32:42.391691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:32:42.391691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:32:42.391691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 3066c1c9c79942c289b733d886d9fd0f Oct 06 12:32:42.391691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-AttachVolumeTestJSON-1894626907-project Oct 06 12:32:42.391691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:32:42.391691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. Oct 06 12:32:42.391691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': 'b7c26e82-69b3-4ffa-97e2-7ca36b941c1f'} Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:32:42.392559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. Oct 06 12:32:42.393869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:32:42.395004 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-fbb38cf4-fb7a-4cff-9d5c-ebb819fc4414 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] Returning 404 to user: Instance b7c26e82-69b3-4ffa-97e2-7ca36b941c1f could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:32:42.395004 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-fbb38cf4-fb7a-4cff-9d5c-ebb819fc4414 tempest-AttachVolumeTestJSON-1894626907 tempest-AttachVolumeTestJSON-1894626907-project] 10.222.0.33 "GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f" status: 404 len: 111 microversion: 2.1 time: 0.029314 Oct 06 12:32:42.395004 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 503/1009] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:32:42 2022] GET /compute/v2.1/servers/b7c26e82-69b3-4ffa-97e2-7ca36b941c1f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:32:42.874285 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-dac419a1-2190-44db-b1ab-7d53f87d0c51 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:42.874940 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-dac419a1-2190-44db-b1ab-7d53f87d0c51 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:42.880806 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dac419a1-2190-44db-b1ab-7d53f87d0c51 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:42.881297 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dac419a1-2190-44db-b1ab-7d53f87d0c51 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:42.881740 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dac419a1-2190-44db-b1ab-7d53f87d0c51 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:42.882435 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dac419a1-2190-44db-b1ab-7d53f87d0c51 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:42.882894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dac419a1-2190-44db-b1ab-7d53f87d0c51 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:42.883326 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dac419a1-2190-44db-b1ab-7d53f87d0c51 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:43.086122 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-dac419a1-2190-44db-b1ab-7d53f87d0c51 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:43.095430 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-dac419a1-2190-44db-b1ab-7d53f87d0c51 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:43.096938 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-dac419a1-2190-44db-b1ab-7d53f87d0c51 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:43.098098 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-dac419a1-2190-44db-b1ab-7d53f87d0c51 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1743 microversion: 2.20 time: 0.227797 Oct 06 12:32:43.098648 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 507/1010] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:42 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1743 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:44.123874 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-49e751dc-14f1-4e32-8b59-293160bebace tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:44.124615 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-49e751dc-14f1-4e32-8b59-293160bebace tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:44.131080 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49e751dc-14f1-4e32-8b59-293160bebace tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:44.131575 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49e751dc-14f1-4e32-8b59-293160bebace tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:44.132008 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49e751dc-14f1-4e32-8b59-293160bebace tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:44.132693 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49e751dc-14f1-4e32-8b59-293160bebace tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:44.133140 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49e751dc-14f1-4e32-8b59-293160bebace tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:44.133552 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-49e751dc-14f1-4e32-8b59-293160bebace tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:44.370090 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-49e751dc-14f1-4e32-8b59-293160bebace tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:44.379212 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-49e751dc-14f1-4e32-8b59-293160bebace tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:44.380691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-49e751dc-14f1-4e32-8b59-293160bebace tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:44.382006 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-49e751dc-14f1-4e32-8b59-293160bebace tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1743 microversion: 2.20 time: 0.261931 Oct 06 12:32:44.383181 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 504/1011] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:44 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1743 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:45.412301 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-327467fc-9a01-43d0-8596-96cd6cb6142a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:45.412993 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-327467fc-9a01-43d0-8596-96cd6cb6142a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:45.421548 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-327467fc-9a01-43d0-8596-96cd6cb6142a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:45.422572 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-327467fc-9a01-43d0-8596-96cd6cb6142a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:45.423174 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-327467fc-9a01-43d0-8596-96cd6cb6142a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:45.424108 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-327467fc-9a01-43d0-8596-96cd6cb6142a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:45.424724 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-327467fc-9a01-43d0-8596-96cd6cb6142a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:45.425294 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-327467fc-9a01-43d0-8596-96cd6cb6142a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:45.641318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-327467fc-9a01-43d0-8596-96cd6cb6142a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:45.654317 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-327467fc-9a01-43d0-8596-96cd6cb6142a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:45.656330 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-327467fc-9a01-43d0-8596-96cd6cb6142a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:45.658021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-327467fc-9a01-43d0-8596-96cd6cb6142a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1743 microversion: 2.20 time: 0.250089 Oct 06 12:32:45.666095 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 508/1012] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:45 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1743 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:45.745693 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-922c31cf-5496-4872-8936-43e9eff7c606 req-cfaa5e23-adc5-4500-9aa5-5ea181432931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c743b80a-43e9-4dc1-a570-6873a5992f34", "name": "network-vif-plugged", "status": "completed", "tag": "fc7be519-3630-4616-ad76-14402cf4ad87"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:32:45.763753 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-922c31cf-5496-4872-8936-43e9eff7c606 req-cfaa5e23-adc5-4500-9aa5-5ea181432931 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:45.764109 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-922c31cf-5496-4872-8936-43e9eff7c606 req-cfaa5e23-adc5-4500-9aa5-5ea181432931 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:45.765832 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-922c31cf-5496-4872-8936-43e9eff7c606 req-cfaa5e23-adc5-4500-9aa5-5ea181432931 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:45.791024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-922c31cf-5496-4872-8936-43e9eff7c606 req-cfaa5e23-adc5-4500-9aa5-5ea181432931 service nova] Creating event network-vif-plugged:fc7be519-3630-4616-ad76-14402cf4ad87 for instance c743b80a-43e9-4dc1-a570-6873a5992f34 on hv-cinder-85604 Oct 06 12:32:45.796873 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-922c31cf-5496-4872-8936-43e9eff7c606 req-cfaa5e23-adc5-4500-9aa5-5ea181432931 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057147 Oct 06 12:32:45.798529 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 505/1013] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:32:46.687939 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-fb7b91a1-eec9-4e09-8ceb-382ff6c30e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:46.688955 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-fb7b91a1-eec9-4e09-8ceb-382ff6c30e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:46.695390 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fb7b91a1-eec9-4e09-8ceb-382ff6c30e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:46.695927 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fb7b91a1-eec9-4e09-8ceb-382ff6c30e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:46.696361 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fb7b91a1-eec9-4e09-8ceb-382ff6c30e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:46.697071 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fb7b91a1-eec9-4e09-8ceb-382ff6c30e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:46.697942 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fb7b91a1-eec9-4e09-8ceb-382ff6c30e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:46.698438 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fb7b91a1-eec9-4e09-8ceb-382ff6c30e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:46.850278 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-fb7b91a1-eec9-4e09-8ceb-382ff6c30e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:46.861078 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-fb7b91a1-eec9-4e09-8ceb-382ff6c30e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:46.862627 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-fb7b91a1-eec9-4e09-8ceb-382ff6c30e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:46.863926 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-fb7b91a1-eec9-4e09-8ceb-382ff6c30e23 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1738 microversion: 2.20 time: 0.181817 Oct 06 12:32:46.864581 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 509/1014] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:46 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:47.897177 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0251531d-a49a-4f3d-b962-65c3abc3003f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:47.899327 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0251531d-a49a-4f3d-b962-65c3abc3003f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:47.907359 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0251531d-a49a-4f3d-b962-65c3abc3003f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:47.908905 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0251531d-a49a-4f3d-b962-65c3abc3003f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:47.909508 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0251531d-a49a-4f3d-b962-65c3abc3003f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:47.910378 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0251531d-a49a-4f3d-b962-65c3abc3003f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:47.910997 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0251531d-a49a-4f3d-b962-65c3abc3003f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:47.911593 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0251531d-a49a-4f3d-b962-65c3abc3003f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:48.265001 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0251531d-a49a-4f3d-b962-65c3abc3003f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:48.273970 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0251531d-a49a-4f3d-b962-65c3abc3003f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:48.277641 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0251531d-a49a-4f3d-b962-65c3abc3003f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:48.280097 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0251531d-a49a-4f3d-b962-65c3abc3003f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1738 microversion: 2.20 time: 0.389371 Oct 06 12:32:48.281244 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 506/1015] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:47 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1738 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:49.308858 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9a33cf2e-d642-47a7-b719-cb76c94db747 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:49.309653 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9a33cf2e-d642-47a7-b719-cb76c94db747 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:49.318438 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9a33cf2e-d642-47a7-b719-cb76c94db747 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:49.318935 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9a33cf2e-d642-47a7-b719-cb76c94db747 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:49.319539 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9a33cf2e-d642-47a7-b719-cb76c94db747 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:49.320429 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9a33cf2e-d642-47a7-b719-cb76c94db747 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:49.320909 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9a33cf2e-d642-47a7-b719-cb76c94db747 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:49.321332 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9a33cf2e-d642-47a7-b719-cb76c94db747 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:49.536974 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9a33cf2e-d642-47a7-b719-cb76c94db747 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:49.546013 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9a33cf2e-d642-47a7-b719-cb76c94db747 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:49.559911 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9a33cf2e-d642-47a7-b719-cb76c94db747 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:49.561436 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9a33cf2e-d642-47a7-b719-cb76c94db747 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1738 microversion: 2.20 time: 0.257779 Oct 06 12:32:49.575713 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 510/1016] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:49 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:50.589327 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-279e137e-e50f-4cde-9d33-5032c566d339 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:50.590578 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-279e137e-e50f-4cde-9d33-5032c566d339 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:50.604689 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-279e137e-e50f-4cde-9d33-5032c566d339 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:50.605591 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-279e137e-e50f-4cde-9d33-5032c566d339 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:50.606233 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-279e137e-e50f-4cde-9d33-5032c566d339 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:50.607146 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-279e137e-e50f-4cde-9d33-5032c566d339 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:50.612306 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-279e137e-e50f-4cde-9d33-5032c566d339 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:50.612980 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-279e137e-e50f-4cde-9d33-5032c566d339 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:50.894656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-279e137e-e50f-4cde-9d33-5032c566d339 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:50.904119 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-279e137e-e50f-4cde-9d33-5032c566d339 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:50.905883 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-279e137e-e50f-4cde-9d33-5032c566d339 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:50.907364 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-279e137e-e50f-4cde-9d33-5032c566d339 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1738 microversion: 2.20 time: 0.323891 Oct 06 12:32:50.924420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 507/1017] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:50 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1738 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:51.936707 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-18bf6d29-97da-4196-984c-411fbfe5ff33 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:51.937969 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-18bf6d29-97da-4196-984c-411fbfe5ff33 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:51.948542 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18bf6d29-97da-4196-984c-411fbfe5ff33 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:51.949339 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18bf6d29-97da-4196-984c-411fbfe5ff33 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:51.953098 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18bf6d29-97da-4196-984c-411fbfe5ff33 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:51.953874 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18bf6d29-97da-4196-984c-411fbfe5ff33 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:51.954344 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18bf6d29-97da-4196-984c-411fbfe5ff33 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:51.954783 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18bf6d29-97da-4196-984c-411fbfe5ff33 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:52.225673 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-18bf6d29-97da-4196-984c-411fbfe5ff33 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:52.246459 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-18bf6d29-97da-4196-984c-411fbfe5ff33 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:52.260348 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-18bf6d29-97da-4196-984c-411fbfe5ff33 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:52.261839 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-18bf6d29-97da-4196-984c-411fbfe5ff33 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1738 microversion: 2.20 time: 0.332288 Oct 06 12:32:52.263182 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 511/1018] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:51 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1738 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:52.904337 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d8837bb8-55ca-465a-909f-4991c8253bd1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Action: 'create', calling method: .version_select at 0x7f03aa708310>, body: {"keypair": {"name": "tempest-keypair-1488367870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF87wTUuK6zhWLG7cHP5ditRt0Wcz1M4YTgKl4yCb7IKcshgvKAu8f4bjeJKskZTRh9ccwElLP+D4pZ7dvSxNsji+393eQShhxoAIy9WrYdbl2FoP/4x20CxZMfaCpUgsg=="}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:32:52.923467 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-d8837bb8-55ca-465a-909f-4991c8253bd1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'key_pairs'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:32:52.927850 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-d8837bb8-55ca-465a-909f-4991c8253bd1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for user 404c5e2b85454e1e91b90fa45796511e and project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'key_pairs'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:32:52.955034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d8837bb8-55ca-465a-909f-4991c8253bd1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.219409 Oct 06 12:32:52.955662 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 508/1019] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 12:32:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:32:53.288573 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8e33ffb8-c389-48f5-94e1-b8267426418c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:53.290012 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8e33ffb8-c389-48f5-94e1-b8267426418c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:53.297589 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e33ffb8-c389-48f5-94e1-b8267426418c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:53.298088 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e33ffb8-c389-48f5-94e1-b8267426418c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:53.298522 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e33ffb8-c389-48f5-94e1-b8267426418c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:53.299228 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e33ffb8-c389-48f5-94e1-b8267426418c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:53.299723 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e33ffb8-c389-48f5-94e1-b8267426418c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:53.300148 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8e33ffb8-c389-48f5-94e1-b8267426418c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:53.470766 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8e33ffb8-c389-48f5-94e1-b8267426418c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:53.488445 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8e33ffb8-c389-48f5-94e1-b8267426418c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:53.493746 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8e33ffb8-c389-48f5-94e1-b8267426418c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:53.498137 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8e33ffb8-c389-48f5-94e1-b8267426418c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1738 microversion: 2.20 time: 0.211524 Oct 06 12:32:53.516265 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 512/1020] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:53 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:54.533054 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-18973db2-4f8b-4b2d-938c-fa4aa3012898 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:54.533806 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-18973db2-4f8b-4b2d-938c-fa4aa3012898 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:54.542247 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-18973db2-4f8b-4b2d-938c-fa4aa3012898 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:54.542987 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-18973db2-4f8b-4b2d-938c-fa4aa3012898 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:54.543449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-18973db2-4f8b-4b2d-938c-fa4aa3012898 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:54.544678 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-18973db2-4f8b-4b2d-938c-fa4aa3012898 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:54.546007 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-18973db2-4f8b-4b2d-938c-fa4aa3012898 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:54.546601 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-18973db2-4f8b-4b2d-938c-fa4aa3012898 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:54.862785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-18973db2-4f8b-4b2d-938c-fa4aa3012898 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:54.889700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-18973db2-4f8b-4b2d-938c-fa4aa3012898 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:54.891971 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-18973db2-4f8b-4b2d-938c-fa4aa3012898 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:54.894523 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-18973db2-4f8b-4b2d-938c-fa4aa3012898 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1738 microversion: 2.20 time: 0.373309 Oct 06 12:32:54.897468 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 509/1021] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:54 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1738 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:55.011560 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-964359570", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "466556a2-70ae-47ab-beee-c79927eef272"}], "security_groups": [{"name": "tempest-securitygroup--846275066"}], "key_name": "tempest-keypair-1488367870", "user_data": "}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:32:55.151015 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.network.neutron [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] validate_networks() for [('466556a2-70ae-47ab-beee-c79927eef272', None, None, None, None, None)] {{(pid=120508) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:32:55.825552 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Flavor limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:32:55.826629 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Image limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:32:55.827104 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Flavor pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:32:55.827499 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Image pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:32:55.828091 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:32:55.839712 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:55.841380 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:55.841989 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:55.842887 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:55.843539 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:55.844117 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:55.871498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:32:55.878327 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for user 404c5e2b85454e1e91b90fa45796511e and project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:32:55.903352 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Going to run 1 instances... {{(pid=120508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:32:55.905750 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:32:55.928628 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0036f06e-8f24-4381-8e46-6559d3f40e09 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:55.930018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0036f06e-8f24-4381-8e46-6559d3f40e09 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:55.941153 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0036f06e-8f24-4381-8e46-6559d3f40e09 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:55.943181 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0036f06e-8f24-4381-8e46-6559d3f40e09 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:55.944876 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0036f06e-8f24-4381-8e46-6559d3f40e09 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:55.949022 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0036f06e-8f24-4381-8e46-6559d3f40e09 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:55.949737 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0036f06e-8f24-4381-8e46-6559d3f40e09 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:55.950555 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0036f06e-8f24-4381-8e46-6559d3f40e09 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:55.966449 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [201d1db6-e0a1-4009-b6ca-ec83b012d2a5] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 12:32:56.159283 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0036f06e-8f24-4381-8e46-6559d3f40e09 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:56.173712 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0036f06e-8f24-4381-8e46-6559d3f40e09 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:56.175402 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0036f06e-8f24-4381-8e46-6559d3f40e09 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:56.176798 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0036f06e-8f24-4381-8e46-6559d3f40e09 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1738 microversion: 2.20 time: 0.255562 Oct 06 12:32:56.177520 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 510/1022] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:55 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:32:56.976799 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO oslo.messaging._drivers.impl_rabbit [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [201d1db6-e0a1-4009-b6ca-ec83b012d2a5] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 43696. Oct 06 12:32:56.985789 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d80ff852-d929-473a-9ad5-1475fa8d2b10 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.977642 Oct 06 12:32:56.987004 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 513/1023] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:32:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 1981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:32:57.001799 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-545ef9b9-2b10-44fe-ba65-095bf1a4e0eb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:57.002420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-545ef9b9-2b10-44fe-ba65-095bf1a4e0eb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:57.093464 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-545ef9b9-2b10-44fe-ba65-095bf1a4e0eb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:57.102973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-545ef9b9-2b10-44fe-ba65-095bf1a4e0eb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1241 microversion: 2.1 time: 0.108817 Oct 06 12:32:57.103548 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 511/1024] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:32:56 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:32:57.225155 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a84aec9d-e25e-414c-97d8-037a635dbac1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:57.226899 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a84aec9d-e25e-414c-97d8-037a635dbac1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:57.236936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a84aec9d-e25e-414c-97d8-037a635dbac1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:57.238081 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a84aec9d-e25e-414c-97d8-037a635dbac1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:57.238748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a84aec9d-e25e-414c-97d8-037a635dbac1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:57.239661 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a84aec9d-e25e-414c-97d8-037a635dbac1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:57.240273 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a84aec9d-e25e-414c-97d8-037a635dbac1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:57.240851 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a84aec9d-e25e-414c-97d8-037a635dbac1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:57.480210 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a84aec9d-e25e-414c-97d8-037a635dbac1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:57.491692 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a84aec9d-e25e-414c-97d8-037a635dbac1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:57.493435 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-a84aec9d-e25e-414c-97d8-037a635dbac1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:57.494761 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a84aec9d-e25e-414c-97d8-037a635dbac1 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1738 microversion: 2.20 time: 0.286939 Oct 06 12:32:57.495826 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 514/1025] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:57 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1738 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:58.129945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-40484843-1b3b-462f-8f6d-edd26e0d4b0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:58.131224 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-40484843-1b3b-462f-8f6d-edd26e0d4b0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:58.140967 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-40484843-1b3b-462f-8f6d-edd26e0d4b0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:58.141464 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-40484843-1b3b-462f-8f6d-edd26e0d4b0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:58.142151 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-40484843-1b3b-462f-8f6d-edd26e0d4b0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:58.143159 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-40484843-1b3b-462f-8f6d-edd26e0d4b0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:58.143993 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-40484843-1b3b-462f-8f6d-edd26e0d4b0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:58.144700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-40484843-1b3b-462f-8f6d-edd26e0d4b0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:58.236027 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-40484843-1b3b-462f-8f6d-edd26e0d4b0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:58.251099 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-40484843-1b3b-462f-8f6d-edd26e0d4b0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1293 microversion: 2.1 time: 0.128693 Oct 06 12:32:58.251950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 512/1026] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:32:58 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:32:58.522628 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2654a125-e89f-426b-8271-43a16c810234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:58.523225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2654a125-e89f-426b-8271-43a16c810234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:58.530783 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2654a125-e89f-426b-8271-43a16c810234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:58.531287 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2654a125-e89f-426b-8271-43a16c810234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:58.531770 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2654a125-e89f-426b-8271-43a16c810234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:58.532473 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2654a125-e89f-426b-8271-43a16c810234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:58.532952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2654a125-e89f-426b-8271-43a16c810234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:58.533376 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2654a125-e89f-426b-8271-43a16c810234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:58.694260 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2654a125-e89f-426b-8271-43a16c810234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:58.705494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2654a125-e89f-426b-8271-43a16c810234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:58.707543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2654a125-e89f-426b-8271-43a16c810234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:58.708819 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2654a125-e89f-426b-8271-43a16c810234 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1738 microversion: 2.20 time: 0.190193 Oct 06 12:32:58.709396 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 515/1027] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:58 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:32:59.275083 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9e54249d-e0fa-4e32-8570-476c844c00d7 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:59.276240 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9e54249d-e0fa-4e32-8570-476c844c00d7 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:59.282760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e54249d-e0fa-4e32-8570-476c844c00d7 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:59.283621 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e54249d-e0fa-4e32-8570-476c844c00d7 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:59.284091 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e54249d-e0fa-4e32-8570-476c844c00d7 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:59.284927 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e54249d-e0fa-4e32-8570-476c844c00d7 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:59.285460 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e54249d-e0fa-4e32-8570-476c844c00d7 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:59.286197 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e54249d-e0fa-4e32-8570-476c844c00d7 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:59.355493 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9e54249d-e0fa-4e32-8570-476c844c00d7 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:59.363112 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9e54249d-e0fa-4e32-8570-476c844c00d7 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1299 microversion: 2.1 time: 0.091989 Oct 06 12:32:59.363739 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 513/1028] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:32:59 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:32:59.737352 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-865b604d-159e-4f47-8aff-0cfa4d55af3c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:32:59.738058 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-865b604d-159e-4f47-8aff-0cfa4d55af3c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:32:59.745161 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-865b604d-159e-4f47-8aff-0cfa4d55af3c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:59.745653 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-865b604d-159e-4f47-8aff-0cfa4d55af3c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:59.746259 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-865b604d-159e-4f47-8aff-0cfa4d55af3c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:59.747088 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-865b604d-159e-4f47-8aff-0cfa4d55af3c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:32:59.747454 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-865b604d-159e-4f47-8aff-0cfa4d55af3c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:32:59.747905 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-865b604d-159e-4f47-8aff-0cfa4d55af3c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:32:59.956963 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-865b604d-159e-4f47-8aff-0cfa4d55af3c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:59.965661 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-865b604d-159e-4f47-8aff-0cfa4d55af3c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:59.967117 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-865b604d-159e-4f47-8aff-0cfa4d55af3c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:32:59.968322 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-865b604d-159e-4f47-8aff-0cfa4d55af3c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1738 microversion: 2.20 time: 0.236080 Oct 06 12:32:59.969105 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 516/1029] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:32:59 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:00.387564 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8c0fefd1-6412-4e67-82d8-38059bcf26b3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:00.388203 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8c0fefd1-6412-4e67-82d8-38059bcf26b3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:00.394340 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c0fefd1-6412-4e67-82d8-38059bcf26b3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:00.394815 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c0fefd1-6412-4e67-82d8-38059bcf26b3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:00.395238 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c0fefd1-6412-4e67-82d8-38059bcf26b3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:00.395973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c0fefd1-6412-4e67-82d8-38059bcf26b3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:00.396420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c0fefd1-6412-4e67-82d8-38059bcf26b3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:00.396839 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c0fefd1-6412-4e67-82d8-38059bcf26b3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:00.520311 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-8b9c4a50-4a2a-4565-b5e9-cb252e4f46c9 req-cb6793a4-2ca1-467a-bfda-1b3a4bf9ac59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82453bcd-3cd1-4cdc-b79a-88a352314608", "tag": "14ef965e-071a-40af-81c7-0d464c9ac0d9"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:33:00.530308 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-8b9c4a50-4a2a-4565-b5e9-cb252e4f46c9 req-cb6793a4-2ca1-467a-bfda-1b3a4bf9ac59 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:00.530795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-8b9c4a50-4a2a-4565-b5e9-cb252e4f46c9 req-cb6793a4-2ca1-467a-bfda-1b3a4bf9ac59 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:00.531227 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-8b9c4a50-4a2a-4565-b5e9-cb252e4f46c9 req-cb6793a4-2ca1-467a-bfda-1b3a4bf9ac59 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:00.542175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-8b9c4a50-4a2a-4565-b5e9-cb252e4f46c9 req-cb6793a4-2ca1-467a-bfda-1b3a4bf9ac59 service nova] Creating event network-changed:14ef965e-071a-40af-81c7-0d464c9ac0d9 for instance 82453bcd-3cd1-4cdc-b79a-88a352314608 on hv-cinder-85604 Oct 06 12:33:00.547343 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-8b9c4a50-4a2a-4565-b5e9-cb252e4f46c9 req-cb6793a4-2ca1-467a-bfda-1b3a4bf9ac59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030653 Oct 06 12:33:00.547969 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 517/1030] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:33:00.604005 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8c0fefd1-6412-4e67-82d8-38059bcf26b3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:00.611728 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8c0fefd1-6412-4e67-82d8-38059bcf26b3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1366 microversion: 2.1 time: 0.228767 Oct 06 12:33:00.612292 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 514/1031] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:00 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:00.993630 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d8751e5e-df48-4b1c-9ef4-1f88e0209bb5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:00.994462 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d8751e5e-df48-4b1c-9ef4-1f88e0209bb5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:01.002148 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8751e5e-df48-4b1c-9ef4-1f88e0209bb5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:01.002715 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8751e5e-df48-4b1c-9ef4-1f88e0209bb5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:01.003221 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8751e5e-df48-4b1c-9ef4-1f88e0209bb5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:01.004184 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8751e5e-df48-4b1c-9ef4-1f88e0209bb5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:01.004995 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8751e5e-df48-4b1c-9ef4-1f88e0209bb5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:01.005529 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d8751e5e-df48-4b1c-9ef4-1f88e0209bb5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:01.184381 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1687483304", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-679794386", "security_groups": [{"name": "tempest-secgroup-smoke-1201469717"}], "block_device_mapping_v2": [{"uuid": "88c40a63-ad67-44d8-bfa1-a6e3b300db68", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "397bf80c-f529-4030-8ca3-f73bf801b9a0"}]}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:33:01.317694 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d8751e5e-df48-4b1c-9ef4-1f88e0209bb5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:01.326413 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d8751e5e-df48-4b1c-9ef4-1f88e0209bb5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:01.327903 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d8751e5e-df48-4b1c-9ef4-1f88e0209bb5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:01.329081 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d8751e5e-df48-4b1c-9ef4-1f88e0209bb5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1720 microversion: 2.20 time: 0.340058 Oct 06 12:33:01.329653 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 518/1032] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:00 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1720 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:01.442781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.network.neutron [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] validate_networks() for [('397bf80c-f529-4030-8ca3-f73bf801b9a0', None, None, None, None, None)] {{(pid=120509) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:33:01.635307 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-01304ae6-90d4-484e-811a-079db06a75ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:01.636068 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-01304ae6-90d4-484e-811a-079db06a75ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:01.642316 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-01304ae6-90d4-484e-811a-079db06a75ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:01.642809 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-01304ae6-90d4-484e-811a-079db06a75ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:01.643304 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-01304ae6-90d4-484e-811a-079db06a75ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:01.644039 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-01304ae6-90d4-484e-811a-079db06a75ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:01.644531 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-01304ae6-90d4-484e-811a-079db06a75ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:01.644960 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-01304ae6-90d4-484e-811a-079db06a75ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:01.985469 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-01304ae6-90d4-484e-811a-079db06a75ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:01.989222 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=100 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:01.994480 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-01304ae6-90d4-484e-811a-079db06a75ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1366 microversion: 2.1 time: 0.363603 Oct 06 12:33:01.995278 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 519/1033] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:01 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:33:02.354670 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b48c4e1a-bb18-4fed-a4cf-0e66d7338b1a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:02.355296 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b48c4e1a-bb18-4fed-a4cf-0e66d7338b1a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:02.361754 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b48c4e1a-bb18-4fed-a4cf-0e66d7338b1a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:02.362249 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b48c4e1a-bb18-4fed-a4cf-0e66d7338b1a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:02.362689 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b48c4e1a-bb18-4fed-a4cf-0e66d7338b1a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:02.363390 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b48c4e1a-bb18-4fed-a4cf-0e66d7338b1a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:02.363878 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b48c4e1a-bb18-4fed-a4cf-0e66d7338b1a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:02.364307 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b48c4e1a-bb18-4fed-a4cf-0e66d7338b1a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:02.632904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b48c4e1a-bb18-4fed-a4cf-0e66d7338b1a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:02.641607 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b48c4e1a-bb18-4fed-a4cf-0e66d7338b1a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:02.643070 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b48c4e1a-bb18-4fed-a4cf-0e66d7338b1a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:02.643618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Flavor limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:33:02.644090 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Image limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:33:02.644272 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b48c4e1a-bb18-4fed-a4cf-0e66d7338b1a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1720 microversion: 2.20 time: 0.293777 Oct 06 12:33:02.644675 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Flavor pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:33:02.644845 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 520/1034] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:02 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1720 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:33:02.645198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Image pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:33:02.645666 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:33:02.654666 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:02.655228 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:02.655699 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:02.656414 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:02.656859 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:02.657277 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:02.673723 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Getting quotas for project c80feb95ecbf413ca0bc52a519bf43b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:33:02.677741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Getting quotas for user dff0daad12c143fabd16d40a1939b87e and project c80feb95ecbf413ca0bc52a519bf43b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:33:02.740660 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Going to run 1 instances... {{(pid=120509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:33:02.742779 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88c40a63-ad67-44d8-bfa1-a6e3b300db68',volume_size=None,volume_type=None)] {{(pid=120509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:33:02.869051 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [33b36ded-2272-444f-b091-967e47f44572] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 12:33:03.016692 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-765a54d8-ebdc-4476-80d9-fbc72aedae5b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:03.017344 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-765a54d8-ebdc-4476-80d9-fbc72aedae5b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:03.023291 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-765a54d8-ebdc-4476-80d9-fbc72aedae5b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:03.023815 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-765a54d8-ebdc-4476-80d9-fbc72aedae5b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:03.024254 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-765a54d8-ebdc-4476-80d9-fbc72aedae5b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:03.024955 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-765a54d8-ebdc-4476-80d9-fbc72aedae5b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:03.025403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-765a54d8-ebdc-4476-80d9-fbc72aedae5b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:03.026088 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-765a54d8-ebdc-4476-80d9-fbc72aedae5b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:03.152664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-765a54d8-ebdc-4476-80d9-fbc72aedae5b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:03.160217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-765a54d8-ebdc-4476-80d9-fbc72aedae5b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1366 microversion: 2.1 time: 0.147402 Oct 06 12:33:03.160787 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 521/1035] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:03 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:33:03.669803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f6c8f945-8ec3-469c-ab25-6b76ced7f6b2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:03.670411 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f6c8f945-8ec3-469c-ab25-6b76ced7f6b2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:03.676790 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6c8f945-8ec3-469c-ab25-6b76ced7f6b2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:03.677273 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6c8f945-8ec3-469c-ab25-6b76ced7f6b2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:03.677705 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6c8f945-8ec3-469c-ab25-6b76ced7f6b2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:03.678391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6c8f945-8ec3-469c-ab25-6b76ced7f6b2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:03.678851 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6c8f945-8ec3-469c-ab25-6b76ced7f6b2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:03.679275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6c8f945-8ec3-469c-ab25-6b76ced7f6b2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:03.811636 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f6c8f945-8ec3-469c-ab25-6b76ced7f6b2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:03.819643 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f6c8f945-8ec3-469c-ab25-6b76ced7f6b2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:03.821084 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f6c8f945-8ec3-469c-ab25-6b76ced7f6b2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:03.822246 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f6c8f945-8ec3-469c-ab25-6b76ced7f6b2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1720 microversion: 2.20 time: 0.156975 Oct 06 12:33:03.823348 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 522/1036] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:03 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:33:03.877634 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO oslo.messaging._drivers.impl_rabbit [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [33b36ded-2272-444f-b091-967e47f44572] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 43780. Oct 06 12:33:03.881858 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a06ef204-3280-461c-8762-6a6d8e40d4be tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.701907 Oct 06 12:33:03.882663 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 515/1037] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:33:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 2703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 12:33:03.894019 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e4a70bc1-749e-4a40-9b1e-77ae7948b303 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:03.894629 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e4a70bc1-749e-4a40-9b1e-77ae7948b303 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:03.965879 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e4a70bc1-749e-4a40-9b1e-77ae7948b303 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:03.974019 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e4a70bc1-749e-4a40-9b1e-77ae7948b303 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1094 microversion: 2.1 time: 0.083708 Oct 06 12:33:03.975289 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 523/1038] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:03 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:04.184398 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c69cfa9b-6431-4c1b-adca-f2a4dd7f6298 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:04.185025 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c69cfa9b-6431-4c1b-adca-f2a4dd7f6298 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:04.191292 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c69cfa9b-6431-4c1b-adca-f2a4dd7f6298 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:04.192050 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c69cfa9b-6431-4c1b-adca-f2a4dd7f6298 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:04.192491 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c69cfa9b-6431-4c1b-adca-f2a4dd7f6298 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:04.193188 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c69cfa9b-6431-4c1b-adca-f2a4dd7f6298 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:04.193644 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c69cfa9b-6431-4c1b-adca-f2a4dd7f6298 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:04.194072 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c69cfa9b-6431-4c1b-adca-f2a4dd7f6298 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:04.325976 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c69cfa9b-6431-4c1b-adca-f2a4dd7f6298 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:04.333467 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c69cfa9b-6431-4c1b-adca-f2a4dd7f6298 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1366 microversion: 2.1 time: 0.153795 Oct 06 12:33:04.334063 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 516/1039] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:04 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:04.848138 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4ae06de0-6a1b-40ca-a0ce-2725a92cd0d5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:04.848787 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-4ae06de0-6a1b-40ca-a0ce-2725a92cd0d5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:04.855791 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4ae06de0-6a1b-40ca-a0ce-2725a92cd0d5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:04.856279 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4ae06de0-6a1b-40ca-a0ce-2725a92cd0d5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:04.856712 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4ae06de0-6a1b-40ca-a0ce-2725a92cd0d5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:04.857398 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4ae06de0-6a1b-40ca-a0ce-2725a92cd0d5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:04.857854 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4ae06de0-6a1b-40ca-a0ce-2725a92cd0d5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:04.858280 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4ae06de0-6a1b-40ca-a0ce-2725a92cd0d5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:04.983101 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4ae06de0-6a1b-40ca-a0ce-2725a92cd0d5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:04.991132 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4ae06de0-6a1b-40ca-a0ce-2725a92cd0d5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:04.992618 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4ae06de0-6a1b-40ca-a0ce-2725a92cd0d5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:04.993786 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4ae06de0-6a1b-40ca-a0ce-2725a92cd0d5 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1720 microversion: 2.20 time: 0.149593 Oct 06 12:33:04.994341 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 524/1040] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:04 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:04.996654 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-94fbbc74-f715-4c8e-9ba5-a01ec8c06e37 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:04.997292 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-94fbbc74-f715-4c8e-9ba5-a01ec8c06e37 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:05.003664 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-94fbbc74-f715-4c8e-9ba5-a01ec8c06e37 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:05.004182 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-94fbbc74-f715-4c8e-9ba5-a01ec8c06e37 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:05.004618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-94fbbc74-f715-4c8e-9ba5-a01ec8c06e37 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:05.005313 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-94fbbc74-f715-4c8e-9ba5-a01ec8c06e37 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:05.005770 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-94fbbc74-f715-4c8e-9ba5-a01ec8c06e37 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:05.006205 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-94fbbc74-f715-4c8e-9ba5-a01ec8c06e37 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:05.068676 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-94fbbc74-f715-4c8e-9ba5-a01ec8c06e37 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:05.076271 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-94fbbc74-f715-4c8e-9ba5-a01ec8c06e37 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1144 microversion: 2.1 time: 0.083602 Oct 06 12:33:05.076835 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 517/1041] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:04 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:33:05.357606 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c984f3b0-97b5-4e9f-9498-04e389f89371 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:05.358236 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c984f3b0-97b5-4e9f-9498-04e389f89371 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:05.364119 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c984f3b0-97b5-4e9f-9498-04e389f89371 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:05.364601 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c984f3b0-97b5-4e9f-9498-04e389f89371 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:05.365030 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c984f3b0-97b5-4e9f-9498-04e389f89371 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:05.365715 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c984f3b0-97b5-4e9f-9498-04e389f89371 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:05.366166 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c984f3b0-97b5-4e9f-9498-04e389f89371 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:05.366581 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c984f3b0-97b5-4e9f-9498-04e389f89371 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:05.428104 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-40c01f3c-4362-49ab-b883-e16788ae5bfc req-22057ac1-3838-4448-8354-697bd6303210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c743b80a-43e9-4dc1-a570-6873a5992f34", "name": "network-vif-unplugged", "status": "completed", "tag": "fc7be519-3630-4616-ad76-14402cf4ad87"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:33:05.438893 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-40c01f3c-4362-49ab-b883-e16788ae5bfc req-22057ac1-3838-4448-8354-697bd6303210 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:05.439474 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-40c01f3c-4362-49ab-b883-e16788ae5bfc req-22057ac1-3838-4448-8354-697bd6303210 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:05.439966 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-40c01f3c-4362-49ab-b883-e16788ae5bfc req-22057ac1-3838-4448-8354-697bd6303210 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:05.453838 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-40c01f3c-4362-49ab-b883-e16788ae5bfc req-22057ac1-3838-4448-8354-697bd6303210 service nova] Creating event network-vif-unplugged:fc7be519-3630-4616-ad76-14402cf4ad87 for instance c743b80a-43e9-4dc1-a570-6873a5992f34 on hv-cinder-85604 Oct 06 12:33:05.459085 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-40c01f3c-4362-49ab-b883-e16788ae5bfc req-22057ac1-3838-4448-8354-697bd6303210 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034832 Oct 06 12:33:05.459925 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 518/1042] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:33:05.497216 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c984f3b0-97b5-4e9f-9498-04e389f89371 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:05.505487 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c984f3b0-97b5-4e9f-9498-04e389f89371 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1366 microversion: 2.1 time: 0.152520 Oct 06 12:33:05.506054 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 525/1043] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:05 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:06.019230 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-1717f09e-a318-4431-b509-7074cb1c1760 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:06.019873 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-1717f09e-a318-4431-b509-7074cb1c1760 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:06.027276 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1717f09e-a318-4431-b509-7074cb1c1760 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:06.027784 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1717f09e-a318-4431-b509-7074cb1c1760 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:06.028220 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1717f09e-a318-4431-b509-7074cb1c1760 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:06.028904 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1717f09e-a318-4431-b509-7074cb1c1760 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:06.029352 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1717f09e-a318-4431-b509-7074cb1c1760 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:06.029772 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1717f09e-a318-4431-b509-7074cb1c1760 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:06.033657 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=97 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:06.100465 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4e0bb5cb-2f0c-43de-b84d-02aef5982ac0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:06.101179 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-4e0bb5cb-2f0c-43de-b84d-02aef5982ac0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:06.103466 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:06.108786 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4e0bb5cb-2f0c-43de-b84d-02aef5982ac0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:06.109267 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4e0bb5cb-2f0c-43de-b84d-02aef5982ac0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:06.109699 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4e0bb5cb-2f0c-43de-b84d-02aef5982ac0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:06.110387 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4e0bb5cb-2f0c-43de-b84d-02aef5982ac0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:06.110837 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4e0bb5cb-2f0c-43de-b84d-02aef5982ac0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:06.111257 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4e0bb5cb-2f0c-43de-b84d-02aef5982ac0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:06.189795 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-1717f09e-a318-4431-b509-7074cb1c1760 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:06.195647 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4e0bb5cb-2f0c-43de-b84d-02aef5982ac0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:06.198729 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-1717f09e-a318-4431-b509-7074cb1c1760 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:06.200241 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-1717f09e-a318-4431-b509-7074cb1c1760 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:06.201410 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-1717f09e-a318-4431-b509-7074cb1c1760 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1720 microversion: 2.20 time: 0.186623 Oct 06 12:33:06.201969 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 519/1044] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:06 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:06.222122 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4e0bb5cb-2f0c-43de-b84d-02aef5982ac0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1144 microversion: 2.1 time: 0.126062 Oct 06 12:33:06.223139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 526/1045] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:06 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1144 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:33:06.528591 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9d0cb629-ef59-4712-adad-a2899206128c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:06.529199 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9d0cb629-ef59-4712-adad-a2899206128c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:06.534995 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9d0cb629-ef59-4712-adad-a2899206128c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:06.535477 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9d0cb629-ef59-4712-adad-a2899206128c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:06.535944 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9d0cb629-ef59-4712-adad-a2899206128c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:06.536674 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9d0cb629-ef59-4712-adad-a2899206128c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:06.537077 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9d0cb629-ef59-4712-adad-a2899206128c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:06.537501 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9d0cb629-ef59-4712-adad-a2899206128c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:06.665612 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9d0cb629-ef59-4712-adad-a2899206128c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:06.674803 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9d0cb629-ef59-4712-adad-a2899206128c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1366 microversion: 2.1 time: 0.150301 Oct 06 12:33:06.675384 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 520/1046] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:06 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:07.227336 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8696638f-7bf1-4c5e-9ed7-ab3ade50a8ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:07.228232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8696638f-7bf1-4c5e-9ed7-ab3ade50a8ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:07.234684 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8696638f-7bf1-4c5e-9ed7-ab3ade50a8ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:07.235201 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8696638f-7bf1-4c5e-9ed7-ab3ade50a8ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:07.235631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8696638f-7bf1-4c5e-9ed7-ab3ade50a8ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:07.236325 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8696638f-7bf1-4c5e-9ed7-ab3ade50a8ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:07.236777 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8696638f-7bf1-4c5e-9ed7-ab3ade50a8ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:07.237202 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8696638f-7bf1-4c5e-9ed7-ab3ade50a8ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:07.245857 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-1772592c-b780-4c20-b6b7-c006fc4d5c8b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:07.247024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-1772592c-b780-4c20-b6b7-c006fc4d5c8b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:07.253484 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1772592c-b780-4c20-b6b7-c006fc4d5c8b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:07.254187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1772592c-b780-4c20-b6b7-c006fc4d5c8b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:07.254772 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1772592c-b780-4c20-b6b7-c006fc4d5c8b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:07.255685 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1772592c-b780-4c20-b6b7-c006fc4d5c8b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:07.256286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1772592c-b780-4c20-b6b7-c006fc4d5c8b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:07.256858 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1772592c-b780-4c20-b6b7-c006fc4d5c8b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:07.362403 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-1772592c-b780-4c20-b6b7-c006fc4d5c8b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:07.375924 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-1772592c-b780-4c20-b6b7-c006fc4d5c8b tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1200 microversion: 2.1 time: 0.133888 Oct 06 12:33:07.377278 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 521/1047] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:07 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1200 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:07.488145 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8696638f-7bf1-4c5e-9ed7-ab3ade50a8ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:07.498374 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8696638f-7bf1-4c5e-9ed7-ab3ade50a8ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:07.499709 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8696638f-7bf1-4c5e-9ed7-ab3ade50a8ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:07.500899 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8696638f-7bf1-4c5e-9ed7-ab3ade50a8ed tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1663 microversion: 2.20 time: 0.277700 Oct 06 12:33:07.501663 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 527/1048] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:07 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1663 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:07.529512 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c36c4ae7-e325-4e66-a401-fac1feed0b8c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "adbe5747-caca-4fcd-b20d-80abc64662d2"}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:33:07.532308 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c36c4ae7-e325-4e66-a401-fac1feed0b8c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:07.538139 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c36c4ae7-e325-4e66-a401-fac1feed0b8c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:07.538630 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c36c4ae7-e325-4e66-a401-fac1feed0b8c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:07.539368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c36c4ae7-e325-4e66-a401-fac1feed0b8c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:07.540107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c36c4ae7-e325-4e66-a401-fac1feed0b8c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:07.540568 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c36c4ae7-e325-4e66-a401-fac1feed0b8c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:07.540998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c36c4ae7-e325-4e66-a401-fac1feed0b8c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:07.700930 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-79272c28-7bc4-4d44-a52a-0996d3e8bda2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:07.701670 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-79272c28-7bc4-4d44-a52a-0996d3e8bda2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:07.708056 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-79272c28-7bc4-4d44-a52a-0996d3e8bda2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:07.708638 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-79272c28-7bc4-4d44-a52a-0996d3e8bda2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:07.709263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-79272c28-7bc4-4d44-a52a-0996d3e8bda2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:07.710171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-79272c28-7bc4-4d44-a52a-0996d3e8bda2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:07.710877 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-79272c28-7bc4-4d44-a52a-0996d3e8bda2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:07.711386 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-79272c28-7bc4-4d44-a52a-0996d3e8bda2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:07.827649 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c36c4ae7-e325-4e66-a401-fac1feed0b8c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "POST /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304211 Oct 06 12:33:07.828645 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 522/1049] 10.222.0.33 () {62 vars in 1364 bytes} [Thu Oct 6 12:33:07 2022] POST /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:33:07.912601 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-79272c28-7bc4-4d44-a52a-0996d3e8bda2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:07.923786 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-79272c28-7bc4-4d44-a52a-0996d3e8bda2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1366 microversion: 2.1 time: 0.228729 Oct 06 12:33:07.925466 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 528/1050] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:07 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:07.961450 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2f30131b-edac-424e-b5d5-b229ea4d1384 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:07.961939 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2f30131b-edac-424e-b5d5-b229ea4d1384 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:07.968247 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f30131b-edac-424e-b5d5-b229ea4d1384 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:07.968743 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f30131b-edac-424e-b5d5-b229ea4d1384 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:07.969167 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f30131b-edac-424e-b5d5-b229ea4d1384 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:07.969852 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f30131b-edac-424e-b5d5-b229ea4d1384 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:07.970298 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f30131b-edac-424e-b5d5-b229ea4d1384 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:07.970714 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f30131b-edac-424e-b5d5-b229ea4d1384 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:08.300090 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2f30131b-edac-424e-b5d5-b229ea4d1384 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34/os-volume_attachments/adbe5747-caca-4fcd-b20d-80abc64662d2" status: 202 len: 0 microversion: 2.20 time: 0.343075 Oct 06 12:33:08.304363 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 523/1051] 10.222.0.33 () {60 vars in 1457 bytes} [Thu Oct 6 12:33:07 2022] DELETE /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34/os-volume_attachments/adbe5747-caca-4fcd-b20d-80abc64662d2 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:33:08.371969 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f326be10-ca96-41f3-96b9-d7c23eda5e99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:33:08.372516 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f326be10-ca96-41f3-96b9-d7c23eda5e99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:08.378938 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f326be10-ca96-41f3-96b9-d7c23eda5e99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:08.379933 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f326be10-ca96-41f3-96b9-d7c23eda5e99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:08.380494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f326be10-ca96-41f3-96b9-d7c23eda5e99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:08.381565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f326be10-ca96-41f3-96b9-d7c23eda5e99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:08.381864 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f326be10-ca96-41f3-96b9-d7c23eda5e99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:08.382285 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f326be10-ca96-41f3-96b9-d7c23eda5e99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:08.400730 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-db7fe932-9ce6-41c7-9ca9-c680dafdc546 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:08.402350 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-db7fe932-9ce6-41c7-9ca9-c680dafdc546 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:08.409650 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db7fe932-9ce6-41c7-9ca9-c680dafdc546 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:08.410481 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db7fe932-9ce6-41c7-9ca9-c680dafdc546 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:08.411075 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db7fe932-9ce6-41c7-9ca9-c680dafdc546 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:08.411925 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db7fe932-9ce6-41c7-9ca9-c680dafdc546 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:08.412482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db7fe932-9ce6-41c7-9ca9-c680dafdc546 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:08.413137 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-db7fe932-9ce6-41c7-9ca9-c680dafdc546 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:08.416646 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f326be10-ca96-41f3-96b9-d7c23eda5e99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120508) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 12:33:08.486229 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f326be10-ca96-41f3-96b9-d7c23eda5e99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "POST /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34/action" status: 202 len: 0 microversion: 2.20 time: 0.118266 Oct 06 12:33:08.490534 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 529/1052] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Oct 6 12:33:08 2022] POST /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:33:08.495967 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2e49e195-e007-426c-9e77-1b78bf0e6453 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:08.497366 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2e49e195-e007-426c-9e77-1b78bf0e6453 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:08.504066 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2e49e195-e007-426c-9e77-1b78bf0e6453 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:08.504883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2e49e195-e007-426c-9e77-1b78bf0e6453 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:08.505310 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2e49e195-e007-426c-9e77-1b78bf0e6453 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:08.506182 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2e49e195-e007-426c-9e77-1b78bf0e6453 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:08.506637 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2e49e195-e007-426c-9e77-1b78bf0e6453 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:08.507058 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2e49e195-e007-426c-9e77-1b78bf0e6453 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:08.778227 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-db7fe932-9ce6-41c7-9ca9-c680dafdc546 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:08.786470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-db7fe932-9ce6-41c7-9ca9-c680dafdc546 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.390463 Oct 06 12:33:08.787128 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 524/1053] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:08 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:33:08.853602 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2e49e195-e007-426c-9e77-1b78bf0e6453 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:08.861666 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2e49e195-e007-426c-9e77-1b78bf0e6453 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:08.863114 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2e49e195-e007-426c-9e77-1b78bf0e6453 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:08.864304 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2e49e195-e007-426c-9e77-1b78bf0e6453 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1671 microversion: 2.20 time: 0.372515 Oct 06 12:33:08.864868 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 530/1054] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:08 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1671 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:08.950575 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-0ea37751-e002-44d3-a005-44bd40fcf6f6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:08.951400 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-0ea37751-e002-44d3-a005-44bd40fcf6f6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:08.958001 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0ea37751-e002-44d3-a005-44bd40fcf6f6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:08.958558 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0ea37751-e002-44d3-a005-44bd40fcf6f6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:08.959469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0ea37751-e002-44d3-a005-44bd40fcf6f6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:08.960331 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0ea37751-e002-44d3-a005-44bd40fcf6f6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:08.960980 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0ea37751-e002-44d3-a005-44bd40fcf6f6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:08.961408 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-0ea37751-e002-44d3-a005-44bd40fcf6f6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:09.165893 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-0ea37751-e002-44d3-a005-44bd40fcf6f6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:09.176890 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-0ea37751-e002-44d3-a005-44bd40fcf6f6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1366 microversion: 2.1 time: 0.231217 Oct 06 12:33:09.177783 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 525/1055] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:08 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:09.312408 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-f2c11e86-84bc-4f3f-b7df-8247a4d43381 req-250f11cf-77ef-4e2f-a416-97e5e80b4208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "621f2a35-3a2e-4b6f-af2b-67399b85d360", "tag": "09838f9f-3bca-496d-a61f-cacc2bc37a5d"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:33:09.322046 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-f2c11e86-84bc-4f3f-b7df-8247a4d43381 req-250f11cf-77ef-4e2f-a416-97e5e80b4208 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:09.322824 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-f2c11e86-84bc-4f3f-b7df-8247a4d43381 req-250f11cf-77ef-4e2f-a416-97e5e80b4208 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:09.324010 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-f2c11e86-84bc-4f3f-b7df-8247a4d43381 req-250f11cf-77ef-4e2f-a416-97e5e80b4208 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:09.352046 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-f2c11e86-84bc-4f3f-b7df-8247a4d43381 req-250f11cf-77ef-4e2f-a416-97e5e80b4208 service nova] Creating event network-changed:09838f9f-3bca-496d-a61f-cacc2bc37a5d for instance 621f2a35-3a2e-4b6f-af2b-67399b85d360 on hv-cinder-85604 Oct 06 12:33:09.364338 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-f2c11e86-84bc-4f3f-b7df-8247a4d43381 req-250f11cf-77ef-4e2f-a416-97e5e80b4208 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052413 Oct 06 12:33:09.364982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 531/1056] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:33:09.506514 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-b95058bc-36a7-4d15-b5e0-ee46f056a4fe req-02599461-0276-45ea-95de-c9ddd9793bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82453bcd-3cd1-4cdc-b79a-88a352314608", "name": "network-vif-plugged", "status": "completed", "tag": "14ef965e-071a-40af-81c7-0d464c9ac0d9"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:33:09.517135 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-b95058bc-36a7-4d15-b5e0-ee46f056a4fe req-02599461-0276-45ea-95de-c9ddd9793bbe service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:09.517776 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-b95058bc-36a7-4d15-b5e0-ee46f056a4fe req-02599461-0276-45ea-95de-c9ddd9793bbe service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:09.518222 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-b95058bc-36a7-4d15-b5e0-ee46f056a4fe req-02599461-0276-45ea-95de-c9ddd9793bbe service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:09.533265 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-b95058bc-36a7-4d15-b5e0-ee46f056a4fe req-02599461-0276-45ea-95de-c9ddd9793bbe service nova] Creating event network-vif-plugged:14ef965e-071a-40af-81c7-0d464c9ac0d9 for instance 82453bcd-3cd1-4cdc-b79a-88a352314608 on hv-cinder-85604 Oct 06 12:33:09.538821 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-b95058bc-36a7-4d15-b5e0-ee46f056a4fe req-02599461-0276-45ea-95de-c9ddd9793bbe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036457 Oct 06 12:33:09.540144 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 526/1057] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:33:09.810787 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-21803e23-01f4-4450-a9c2-388f048c9173 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:09.811403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-21803e23-01f4-4450-a9c2-388f048c9173 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:09.817702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-21803e23-01f4-4450-a9c2-388f048c9173 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:09.818185 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-21803e23-01f4-4450-a9c2-388f048c9173 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:09.818616 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-21803e23-01f4-4450-a9c2-388f048c9173 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:09.819295 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-21803e23-01f4-4450-a9c2-388f048c9173 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:09.819776 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-21803e23-01f4-4450-a9c2-388f048c9173 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:09.820201 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-21803e23-01f4-4450-a9c2-388f048c9173 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:09.891472 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-87b95b7a-e560-45b0-b265-8da9a25d13f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:09.892525 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-87b95b7a-e560-45b0-b265-8da9a25d13f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:09.899656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-87b95b7a-e560-45b0-b265-8da9a25d13f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:09.900148 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-87b95b7a-e560-45b0-b265-8da9a25d13f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:09.900582 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-87b95b7a-e560-45b0-b265-8da9a25d13f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:09.901573 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-87b95b7a-e560-45b0-b265-8da9a25d13f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:09.902176 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-87b95b7a-e560-45b0-b265-8da9a25d13f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:09.902604 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-87b95b7a-e560-45b0-b265-8da9a25d13f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:10.149655 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-21803e23-01f4-4450-a9c2-388f048c9173 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:10.157640 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-21803e23-01f4-4450-a9c2-388f048c9173 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.352161 Oct 06 12:33:10.158227 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 532/1058] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:09 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:10.175292 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-87b95b7a-e560-45b0-b265-8da9a25d13f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:10.183912 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-87b95b7a-e560-45b0-b265-8da9a25d13f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:10.185423 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-87b95b7a-e560-45b0-b265-8da9a25d13f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:10.186748 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-87b95b7a-e560-45b0-b265-8da9a25d13f4 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.300287 Oct 06 12:33:10.187312 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 527/1059] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:09 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:10.200223 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2f4e1e80-1ef2-4009-b1ec-4ec30747354a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:10.200841 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2f4e1e80-1ef2-4009-b1ec-4ec30747354a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:10.206722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2f4e1e80-1ef2-4009-b1ec-4ec30747354a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:10.207212 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2f4e1e80-1ef2-4009-b1ec-4ec30747354a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:10.207814 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2f4e1e80-1ef2-4009-b1ec-4ec30747354a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:10.208515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2f4e1e80-1ef2-4009-b1ec-4ec30747354a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:10.208977 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2f4e1e80-1ef2-4009-b1ec-4ec30747354a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:10.209409 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2f4e1e80-1ef2-4009-b1ec-4ec30747354a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:10.333905 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2f4e1e80-1ef2-4009-b1ec-4ec30747354a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:10.341541 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2f4e1e80-1ef2-4009-b1ec-4ec30747354a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1366 microversion: 2.1 time: 0.145120 Oct 06 12:33:10.342045 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 533/1060] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:10 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:11.180222 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-efd850b9-4ae0-4f7e-bc9c-8ed3e466cfbc tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:11.180857 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-efd850b9-4ae0-4f7e-bc9c-8ed3e466cfbc tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:11.183340 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:11.188890 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-efd850b9-4ae0-4f7e-bc9c-8ed3e466cfbc tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:11.189367 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-efd850b9-4ae0-4f7e-bc9c-8ed3e466cfbc tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:11.189794 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-efd850b9-4ae0-4f7e-bc9c-8ed3e466cfbc tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:11.190470 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-efd850b9-4ae0-4f7e-bc9c-8ed3e466cfbc tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:11.190912 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-efd850b9-4ae0-4f7e-bc9c-8ed3e466cfbc tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:11.191333 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-efd850b9-4ae0-4f7e-bc9c-8ed3e466cfbc tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:11.211722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-126bf023-03fc-4d6a-9528-b29b69749bf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:11.212459 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-126bf023-03fc-4d6a-9528-b29b69749bf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:11.219473 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-126bf023-03fc-4d6a-9528-b29b69749bf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:11.220009 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-126bf023-03fc-4d6a-9528-b29b69749bf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:11.220475 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-126bf023-03fc-4d6a-9528-b29b69749bf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:11.221165 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-126bf023-03fc-4d6a-9528-b29b69749bf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:11.221622 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-126bf023-03fc-4d6a-9528-b29b69749bf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:11.222048 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-126bf023-03fc-4d6a-9528-b29b69749bf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:11.386777 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-efd850b9-4ae0-4f7e-bc9c-8ed3e466cfbc tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:11.393779 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-126bf023-03fc-4d6a-9528-b29b69749bf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:11.396634 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-efd850b9-4ae0-4f7e-bc9c-8ed3e466cfbc tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.220126 Oct 06 12:33:11.397929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 528/1061] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:11 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:11.402504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f17a326a-34e5-456e-86ba-9e720dbf6bc8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:11.403103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f17a326a-34e5-456e-86ba-9e720dbf6bc8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:11.404717 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-126bf023-03fc-4d6a-9528-b29b69749bf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:11.406495 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-126bf023-03fc-4d6a-9528-b29b69749bf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:11.408595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-126bf023-03fc-4d6a-9528-b29b69749bf6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.200647 Oct 06 12:33:11.409684 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 534/1062] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:11 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:33:11.409804 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f17a326a-34e5-456e-86ba-9e720dbf6bc8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:11.411451 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f17a326a-34e5-456e-86ba-9e720dbf6bc8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:11.412106 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f17a326a-34e5-456e-86ba-9e720dbf6bc8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:11.413098 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f17a326a-34e5-456e-86ba-9e720dbf6bc8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:11.413864 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f17a326a-34e5-456e-86ba-9e720dbf6bc8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:11.414276 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f17a326a-34e5-456e-86ba-9e720dbf6bc8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:11.543644 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f17a326a-34e5-456e-86ba-9e720dbf6bc8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:11.551170 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f17a326a-34e5-456e-86ba-9e720dbf6bc8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1366 microversion: 2.1 time: 0.152675 Oct 06 12:33:11.551762 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 529/1063] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:11 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:12.419965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-72777581-05ca-4b25-8ae2-01f7bc560d66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:12.420575 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-72777581-05ca-4b25-8ae2-01f7bc560d66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:12.423215 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:12.428585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-72777581-05ca-4b25-8ae2-01f7bc560d66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:12.429068 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-72777581-05ca-4b25-8ae2-01f7bc560d66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:12.429556 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-72777581-05ca-4b25-8ae2-01f7bc560d66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:12.430578 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-72777581-05ca-4b25-8ae2-01f7bc560d66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:12.431366 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-72777581-05ca-4b25-8ae2-01f7bc560d66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:12.432102 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-72777581-05ca-4b25-8ae2-01f7bc560d66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:12.434935 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-fcb2001b-7211-44c7-b3c0-43e7bb49d1d2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:12.435568 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-fcb2001b-7211-44c7-b3c0-43e7bb49d1d2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:12.441927 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fcb2001b-7211-44c7-b3c0-43e7bb49d1d2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:12.442420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fcb2001b-7211-44c7-b3c0-43e7bb49d1d2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:12.442852 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fcb2001b-7211-44c7-b3c0-43e7bb49d1d2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:12.443573 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fcb2001b-7211-44c7-b3c0-43e7bb49d1d2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:12.444032 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fcb2001b-7211-44c7-b3c0-43e7bb49d1d2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:12.444454 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fcb2001b-7211-44c7-b3c0-43e7bb49d1d2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:12.665152 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:12.684789 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=12 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:12.790464 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fcb2001b-7211-44c7-b3c0-43e7bb49d1d2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:12.798926 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fcb2001b-7211-44c7-b3c0-43e7bb49d1d2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:12.801223 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fcb2001b-7211-44c7-b3c0-43e7bb49d1d2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:12.802282 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-72777581-05ca-4b25-8ae2-01f7bc560d66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:12.802401 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-fcb2001b-7211-44c7-b3c0-43e7bb49d1d2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.371829 Oct 06 12:33:12.802960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 530/1064] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:12 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:12.808160 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2f90044a-41d3-4c31-9508-3f0e81b0b084 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:12.808761 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2f90044a-41d3-4c31-9508-3f0e81b0b084 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:12.814705 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f90044a-41d3-4c31-9508-3f0e81b0b084 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:12.815177 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f90044a-41d3-4c31-9508-3f0e81b0b084 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:12.815736 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f90044a-41d3-4c31-9508-3f0e81b0b084 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:12.816447 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f90044a-41d3-4c31-9508-3f0e81b0b084 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:12.817092 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f90044a-41d3-4c31-9508-3f0e81b0b084 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:12.817533 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f90044a-41d3-4c31-9508-3f0e81b0b084 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:12.821880 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:12.822643 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-72777581-05ca-4b25-8ae2-01f7bc560d66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.406829 Oct 06 12:33:12.830654 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 535/1065] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:12 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:13.154743 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2f90044a-41d3-4c31-9508-3f0e81b0b084 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:13.162579 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2f90044a-41d3-4c31-9508-3f0e81b0b084 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1556 microversion: 2.1 time: 0.358605 Oct 06 12:33:13.163155 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 531/1066] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:12 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1556 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:13.186382 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2eaec65d-de39-4e96-9f26-34ae6bd7aa39 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:13.187044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2eaec65d-de39-4e96-9f26-34ae6bd7aa39 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:13.193069 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2eaec65d-de39-4e96-9f26-34ae6bd7aa39 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:13.193551 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2eaec65d-de39-4e96-9f26-34ae6bd7aa39 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:13.193980 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2eaec65d-de39-4e96-9f26-34ae6bd7aa39 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:13.194670 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2eaec65d-de39-4e96-9f26-34ae6bd7aa39 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:13.195127 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2eaec65d-de39-4e96-9f26-34ae6bd7aa39 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:13.195583 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2eaec65d-de39-4e96-9f26-34ae6bd7aa39 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:13.324403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2eaec65d-de39-4e96-9f26-34ae6bd7aa39 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142683 Oct 06 12:33:13.325002 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 536/1067] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 12:33:13 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:33:13.829259 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8666e85a-3e62-4fc6-9628-73769d02219d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:13.830754 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8666e85a-3e62-4fc6-9628-73769d02219d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:13.839153 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8666e85a-3e62-4fc6-9628-73769d02219d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:13.839925 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8666e85a-3e62-4fc6-9628-73769d02219d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:13.840535 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8666e85a-3e62-4fc6-9628-73769d02219d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:13.846701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8dab1ab6-0e0b-40fd-9ac6-7ea24de83704 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:13.848495 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8dab1ab6-0e0b-40fd-9ac6-7ea24de83704 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:13.863332 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8666e85a-3e62-4fc6-9628-73769d02219d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:13.865062 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8666e85a-3e62-4fc6-9628-73769d02219d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:13.866003 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8666e85a-3e62-4fc6-9628-73769d02219d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:13.867538 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8dab1ab6-0e0b-40fd-9ac6-7ea24de83704 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:13.872278 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8dab1ab6-0e0b-40fd-9ac6-7ea24de83704 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:13.872981 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8dab1ab6-0e0b-40fd-9ac6-7ea24de83704 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:13.873892 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8dab1ab6-0e0b-40fd-9ac6-7ea24de83704 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:13.874582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8dab1ab6-0e0b-40fd-9ac6-7ea24de83704 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:13.875548 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8dab1ab6-0e0b-40fd-9ac6-7ea24de83704 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:13.930426 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:13.970594 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=8 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:14.273860 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8666e85a-3e62-4fc6-9628-73769d02219d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:14.290843 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8666e85a-3e62-4fc6-9628-73769d02219d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:14.292882 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8666e85a-3e62-4fc6-9628-73769d02219d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:14.294064 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8666e85a-3e62-4fc6-9628-73769d02219d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.468653 Oct 06 12:33:14.294828 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 532/1068] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:13 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:14.373134 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8dab1ab6-0e0b-40fd-9ac6-7ea24de83704 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:14.381841 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8dab1ab6-0e0b-40fd-9ac6-7ea24de83704 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.539343 Oct 06 12:33:14.396323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 537/1069] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:13 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:14.637055 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-8be56a11-7534-401a-b2a8-9e8913da2fc2 req-a48b250a-77e7-40f8-a648-abe89db99325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82453bcd-3cd1-4cdc-b79a-88a352314608", "tag": "14ef965e-071a-40af-81c7-0d464c9ac0d9"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:33:14.646784 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-8be56a11-7534-401a-b2a8-9e8913da2fc2 req-a48b250a-77e7-40f8-a648-abe89db99325 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:14.647303 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-8be56a11-7534-401a-b2a8-9e8913da2fc2 req-a48b250a-77e7-40f8-a648-abe89db99325 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:14.647735 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-8be56a11-7534-401a-b2a8-9e8913da2fc2 req-a48b250a-77e7-40f8-a648-abe89db99325 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:14.660162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-8be56a11-7534-401a-b2a8-9e8913da2fc2 req-a48b250a-77e7-40f8-a648-abe89db99325 service nova] Creating event network-changed:14ef965e-071a-40af-81c7-0d464c9ac0d9 for instance 82453bcd-3cd1-4cdc-b79a-88a352314608 on hv-cinder-85604 Oct 06 12:33:14.672404 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-8be56a11-7534-401a-b2a8-9e8913da2fc2 req-a48b250a-77e7-40f8-a648-abe89db99325 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038909 Oct 06 12:33:14.673265 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 533/1070] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:33:15.325903 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3abf7b6b-539f-4f37-bba3-b26b327bb4bc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:15.326516 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3abf7b6b-539f-4f37-bba3-b26b327bb4bc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:15.335543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3abf7b6b-539f-4f37-bba3-b26b327bb4bc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:15.336320 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3abf7b6b-539f-4f37-bba3-b26b327bb4bc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:15.336758 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3abf7b6b-539f-4f37-bba3-b26b327bb4bc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:15.337466 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3abf7b6b-539f-4f37-bba3-b26b327bb4bc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:15.337923 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3abf7b6b-539f-4f37-bba3-b26b327bb4bc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:15.338345 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3abf7b6b-539f-4f37-bba3-b26b327bb4bc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:15.406884 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-70496e03-b8ed-4e0b-ab64-981a6b9a8370 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:15.407976 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-70496e03-b8ed-4e0b-ab64-981a6b9a8370 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:15.436563 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-70496e03-b8ed-4e0b-ab64-981a6b9a8370 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:15.437281 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-70496e03-b8ed-4e0b-ab64-981a6b9a8370 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:15.437736 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-70496e03-b8ed-4e0b-ab64-981a6b9a8370 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:15.438455 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-70496e03-b8ed-4e0b-ab64-981a6b9a8370 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:15.438953 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-70496e03-b8ed-4e0b-ab64-981a6b9a8370 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:15.439344 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-70496e03-b8ed-4e0b-ab64-981a6b9a8370 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:15.486503 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3abf7b6b-539f-4f37-bba3-b26b327bb4bc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:15.505280 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3abf7b6b-539f-4f37-bba3-b26b327bb4bc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:15.506879 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3abf7b6b-539f-4f37-bba3-b26b327bb4bc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:15.507944 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3abf7b6b-539f-4f37-bba3-b26b327bb4bc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.186597 Oct 06 12:33:15.508840 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 538/1071] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:15 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:15.603237 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-70496e03-b8ed-4e0b-ab64-981a6b9a8370 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:15.612153 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-70496e03-b8ed-4e0b-ab64-981a6b9a8370 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.209294 Oct 06 12:33:15.612349 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 534/1072] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:15 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:33:16.533403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ee556c62-fa55-46be-80f6-f31e48c3fd66 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:16.534004 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ee556c62-fa55-46be-80f6-f31e48c3fd66 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:16.540300 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee556c62-fa55-46be-80f6-f31e48c3fd66 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:16.540793 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee556c62-fa55-46be-80f6-f31e48c3fd66 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:16.541231 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee556c62-fa55-46be-80f6-f31e48c3fd66 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:16.542105 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee556c62-fa55-46be-80f6-f31e48c3fd66 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:16.542739 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee556c62-fa55-46be-80f6-f31e48c3fd66 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:16.543362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ee556c62-fa55-46be-80f6-f31e48c3fd66 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:16.636663 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f73c2ab7-1946-4893-8a0b-a17a5ed5e768 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:16.638556 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f73c2ab7-1946-4893-8a0b-a17a5ed5e768 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:16.649127 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f73c2ab7-1946-4893-8a0b-a17a5ed5e768 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:16.650116 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f73c2ab7-1946-4893-8a0b-a17a5ed5e768 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:16.650995 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f73c2ab7-1946-4893-8a0b-a17a5ed5e768 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:16.652228 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f73c2ab7-1946-4893-8a0b-a17a5ed5e768 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:16.652898 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f73c2ab7-1946-4893-8a0b-a17a5ed5e768 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:16.653553 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f73c2ab7-1946-4893-8a0b-a17a5ed5e768 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:16.691821 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ee556c62-fa55-46be-80f6-f31e48c3fd66 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:16.702029 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ee556c62-fa55-46be-80f6-f31e48c3fd66 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:16.703722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-ee556c62-fa55-46be-80f6-f31e48c3fd66 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:16.704961 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ee556c62-fa55-46be-80f6-f31e48c3fd66 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.175603 Oct 06 12:33:16.705907 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 539/1073] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:16 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:33:16.803000 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f73c2ab7-1946-4893-8a0b-a17a5ed5e768 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:16.817840 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f73c2ab7-1946-4893-8a0b-a17a5ed5e768 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.186317 Oct 06 12:33:16.819066 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 535/1074] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:16 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:33:17.730467 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4d1869f1-f0d4-49e9-82e9-f05078bf9edd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:17.731883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-4d1869f1-f0d4-49e9-82e9-f05078bf9edd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:17.738546 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d1869f1-f0d4-49e9-82e9-f05078bf9edd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:17.739036 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d1869f1-f0d4-49e9-82e9-f05078bf9edd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:17.739483 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d1869f1-f0d4-49e9-82e9-f05078bf9edd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:17.740355 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d1869f1-f0d4-49e9-82e9-f05078bf9edd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:17.740819 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d1869f1-f0d4-49e9-82e9-f05078bf9edd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:17.741252 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4d1869f1-f0d4-49e9-82e9-f05078bf9edd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:17.857237 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f3970d38-bc2d-4304-b0af-b52b4a3b0b18 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:17.857859 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f3970d38-bc2d-4304-b0af-b52b4a3b0b18 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:17.864238 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f3970d38-bc2d-4304-b0af-b52b4a3b0b18 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:17.865085 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f3970d38-bc2d-4304-b0af-b52b4a3b0b18 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:17.865753 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f3970d38-bc2d-4304-b0af-b52b4a3b0b18 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:17.866683 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f3970d38-bc2d-4304-b0af-b52b4a3b0b18 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:17.867354 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f3970d38-bc2d-4304-b0af-b52b4a3b0b18 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:17.868005 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f3970d38-bc2d-4304-b0af-b52b4a3b0b18 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:17.880600 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4d1869f1-f0d4-49e9-82e9-f05078bf9edd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:17.889892 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4d1869f1-f0d4-49e9-82e9-f05078bf9edd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:17.891929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4d1869f1-f0d4-49e9-82e9-f05078bf9edd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:17.893242 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4d1869f1-f0d4-49e9-82e9-f05078bf9edd tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.166564 Oct 06 12:33:17.907544 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 540/1075] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:17 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:18.020081 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f3970d38-bc2d-4304-b0af-b52b4a3b0b18 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:18.028395 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f3970d38-bc2d-4304-b0af-b52b4a3b0b18 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.186455 Oct 06 12:33:18.028965 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 536/1076] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:17 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:18.919019 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-fb053f13-39e1-4d65-8d29-2a726e7520b6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:18.919669 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-fb053f13-39e1-4d65-8d29-2a726e7520b6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:18.926139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fb053f13-39e1-4d65-8d29-2a726e7520b6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:18.926658 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fb053f13-39e1-4d65-8d29-2a726e7520b6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:18.927102 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fb053f13-39e1-4d65-8d29-2a726e7520b6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:18.927825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fb053f13-39e1-4d65-8d29-2a726e7520b6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:18.928286 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fb053f13-39e1-4d65-8d29-2a726e7520b6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:18.928714 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fb053f13-39e1-4d65-8d29-2a726e7520b6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:19.050495 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-958d622f-717c-487b-a443-ded3d7f3fa13 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:19.051097 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-958d622f-717c-487b-a443-ded3d7f3fa13 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:19.057962 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-958d622f-717c-487b-a443-ded3d7f3fa13 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:19.058444 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-958d622f-717c-487b-a443-ded3d7f3fa13 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:19.058873 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-958d622f-717c-487b-a443-ded3d7f3fa13 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:19.059590 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-958d622f-717c-487b-a443-ded3d7f3fa13 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:19.061494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-958d622f-717c-487b-a443-ded3d7f3fa13 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:19.061943 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-958d622f-717c-487b-a443-ded3d7f3fa13 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:19.084066 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-fb053f13-39e1-4d65-8d29-2a726e7520b6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:19.092735 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-fb053f13-39e1-4d65-8d29-2a726e7520b6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:19.094434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-fb053f13-39e1-4d65-8d29-2a726e7520b6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:19.096030 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-fb053f13-39e1-4d65-8d29-2a726e7520b6 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.180753 Oct 06 12:33:19.096813 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 541/1077] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:18 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:19.200622 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-958d622f-717c-487b-a443-ded3d7f3fa13 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:19.208997 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-958d622f-717c-487b-a443-ded3d7f3fa13 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.162216 Oct 06 12:33:19.209784 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 537/1078] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:19 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:33:20.122023 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-16c1d4f3-3f15-4c38-a1a7-4cc3702d4a2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:20.122636 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-16c1d4f3-3f15-4c38-a1a7-4cc3702d4a2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:20.129096 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16c1d4f3-3f15-4c38-a1a7-4cc3702d4a2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:20.129588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16c1d4f3-3f15-4c38-a1a7-4cc3702d4a2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:20.130048 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16c1d4f3-3f15-4c38-a1a7-4cc3702d4a2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:20.130736 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16c1d4f3-3f15-4c38-a1a7-4cc3702d4a2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:20.131196 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16c1d4f3-3f15-4c38-a1a7-4cc3702d4a2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:20.131657 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-16c1d4f3-3f15-4c38-a1a7-4cc3702d4a2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:20.231485 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d7b40880-635d-426d-963d-758eed6f8517 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:20.232939 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d7b40880-635d-426d-963d-758eed6f8517 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:20.240233 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d7b40880-635d-426d-963d-758eed6f8517 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:20.240971 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d7b40880-635d-426d-963d-758eed6f8517 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:20.241575 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d7b40880-635d-426d-963d-758eed6f8517 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:20.242607 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d7b40880-635d-426d-963d-758eed6f8517 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:20.243226 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d7b40880-635d-426d-963d-758eed6f8517 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:20.243867 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d7b40880-635d-426d-963d-758eed6f8517 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:20.282061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-16c1d4f3-3f15-4c38-a1a7-4cc3702d4a2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:20.290344 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-16c1d4f3-3f15-4c38-a1a7-4cc3702d4a2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:20.292534 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-16c1d4f3-3f15-4c38-a1a7-4cc3702d4a2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:20.293728 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-16c1d4f3-3f15-4c38-a1a7-4cc3702d4a2a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.176192 Oct 06 12:33:20.294303 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 542/1079] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:20 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:20.379585 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d7b40880-635d-426d-963d-758eed6f8517 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:20.387198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d7b40880-635d-426d-963d-758eed6f8517 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.160201 Oct 06 12:33:20.387806 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 538/1080] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:20 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:21.318366 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-32683510-9a2a-4fc4-a70d-2015aafbf130 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:21.318907 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-32683510-9a2a-4fc4-a70d-2015aafbf130 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:21.325626 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32683510-9a2a-4fc4-a70d-2015aafbf130 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:21.326106 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32683510-9a2a-4fc4-a70d-2015aafbf130 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:21.326535 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32683510-9a2a-4fc4-a70d-2015aafbf130 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:21.327219 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32683510-9a2a-4fc4-a70d-2015aafbf130 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:21.327705 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32683510-9a2a-4fc4-a70d-2015aafbf130 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:21.328128 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-32683510-9a2a-4fc4-a70d-2015aafbf130 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:21.412058 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4695d31a-7feb-432e-9173-efbdf72c07db tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:21.413420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4695d31a-7feb-432e-9173-efbdf72c07db tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:21.420855 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4695d31a-7feb-432e-9173-efbdf72c07db tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:21.421698 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4695d31a-7feb-432e-9173-efbdf72c07db tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:21.422364 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4695d31a-7feb-432e-9173-efbdf72c07db tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:21.423290 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4695d31a-7feb-432e-9173-efbdf72c07db tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:21.423969 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4695d31a-7feb-432e-9173-efbdf72c07db tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:21.424617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4695d31a-7feb-432e-9173-efbdf72c07db tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:21.540445 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-32683510-9a2a-4fc4-a70d-2015aafbf130 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:21.549262 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-32683510-9a2a-4fc4-a70d-2015aafbf130 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:21.550982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-32683510-9a2a-4fc4-a70d-2015aafbf130 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:21.552424 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-32683510-9a2a-4fc4-a70d-2015aafbf130 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.238131 Oct 06 12:33:21.553524 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 543/1081] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:21 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:21.596449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4695d31a-7feb-432e-9173-efbdf72c07db tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:21.604468 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4695d31a-7feb-432e-9173-efbdf72c07db tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.197719 Oct 06 12:33:21.605037 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 539/1082] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:21 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:22.579595 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b6fa5d12-77a2-4adf-ad18-14cd6afbad31 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:22.580327 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b6fa5d12-77a2-4adf-ad18-14cd6afbad31 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:22.588130 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6fa5d12-77a2-4adf-ad18-14cd6afbad31 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:22.589346 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6fa5d12-77a2-4adf-ad18-14cd6afbad31 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:22.589828 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6fa5d12-77a2-4adf-ad18-14cd6afbad31 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:22.590540 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6fa5d12-77a2-4adf-ad18-14cd6afbad31 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:22.591000 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6fa5d12-77a2-4adf-ad18-14cd6afbad31 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:22.591430 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b6fa5d12-77a2-4adf-ad18-14cd6afbad31 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:22.629110 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4c4b34a6-f393-4e60-beac-e3cd10f9deb5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:22.629842 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4c4b34a6-f393-4e60-beac-e3cd10f9deb5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:22.636682 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4c4b34a6-f393-4e60-beac-e3cd10f9deb5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:22.637161 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4c4b34a6-f393-4e60-beac-e3cd10f9deb5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:22.637592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4c4b34a6-f393-4e60-beac-e3cd10f9deb5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:22.638278 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4c4b34a6-f393-4e60-beac-e3cd10f9deb5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:22.638721 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4c4b34a6-f393-4e60-beac-e3cd10f9deb5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:22.639136 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4c4b34a6-f393-4e60-beac-e3cd10f9deb5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:22.778142 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b6fa5d12-77a2-4adf-ad18-14cd6afbad31 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:22.788269 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b6fa5d12-77a2-4adf-ad18-14cd6afbad31 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:22.789912 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b6fa5d12-77a2-4adf-ad18-14cd6afbad31 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:22.791114 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b6fa5d12-77a2-4adf-ad18-14cd6afbad31 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.217101 Oct 06 12:33:22.793510 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 544/1083] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:22 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:22.806820 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4c4b34a6-f393-4e60-beac-e3cd10f9deb5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:22.820886 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4c4b34a6-f393-4e60-beac-e3cd10f9deb5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.195415 Oct 06 12:33:22.821820 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 540/1084] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:22 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:33:23.824202 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4746ff9d-f713-4240-99cf-bee0baf924c3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:23.825099 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-4746ff9d-f713-4240-99cf-bee0baf924c3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:23.833185 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4746ff9d-f713-4240-99cf-bee0baf924c3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:23.834103 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4746ff9d-f713-4240-99cf-bee0baf924c3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:23.834555 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4746ff9d-f713-4240-99cf-bee0baf924c3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:23.835448 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4746ff9d-f713-4240-99cf-bee0baf924c3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:23.835993 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4746ff9d-f713-4240-99cf-bee0baf924c3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:23.836547 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4746ff9d-f713-4240-99cf-bee0baf924c3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:23.847198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e38d0fda-5dd3-4b03-a2e4-ffb37e8261a0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:23.848418 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e38d0fda-5dd3-4b03-a2e4-ffb37e8261a0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:23.855471 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e38d0fda-5dd3-4b03-a2e4-ffb37e8261a0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:23.856526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e38d0fda-5dd3-4b03-a2e4-ffb37e8261a0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:23.857139 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e38d0fda-5dd3-4b03-a2e4-ffb37e8261a0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:23.858042 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e38d0fda-5dd3-4b03-a2e4-ffb37e8261a0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:23.858668 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e38d0fda-5dd3-4b03-a2e4-ffb37e8261a0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:23.859275 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e38d0fda-5dd3-4b03-a2e4-ffb37e8261a0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:24.055323 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4746ff9d-f713-4240-99cf-bee0baf924c3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:24.058744 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e38d0fda-5dd3-4b03-a2e4-ffb37e8261a0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:24.063719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4746ff9d-f713-4240-99cf-bee0baf924c3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:24.065188 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4746ff9d-f713-4240-99cf-bee0baf924c3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:24.066311 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e38d0fda-5dd3-4b03-a2e4-ffb37e8261a0 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.223410 Oct 06 12:33:24.066451 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4746ff9d-f713-4240-99cf-bee0baf924c3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.247954 Oct 06 12:33:24.067102 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 541/1086] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:23 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:24.067253 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 545/1086] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:23 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:25.089742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4d484517-2edd-4532-8cf1-0cf1f44b8b98 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:25.090292 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4d484517-2edd-4532-8cf1-0cf1f44b8b98 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:25.091103 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-28722822-30e3-4a55-8760-22671d279ef0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:25.091737 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-28722822-30e3-4a55-8760-22671d279ef0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:25.097574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4d484517-2edd-4532-8cf1-0cf1f44b8b98 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:25.098161 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4d484517-2edd-4532-8cf1-0cf1f44b8b98 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:25.098694 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4d484517-2edd-4532-8cf1-0cf1f44b8b98 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:25.098823 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28722822-30e3-4a55-8760-22671d279ef0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:25.099317 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28722822-30e3-4a55-8760-22671d279ef0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:25.099930 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4d484517-2edd-4532-8cf1-0cf1f44b8b98 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:25.100064 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28722822-30e3-4a55-8760-22671d279ef0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:25.100598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4d484517-2edd-4532-8cf1-0cf1f44b8b98 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:25.100707 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28722822-30e3-4a55-8760-22671d279ef0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:25.101093 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28722822-30e3-4a55-8760-22671d279ef0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:25.101198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4d484517-2edd-4532-8cf1-0cf1f44b8b98 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:25.101552 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28722822-30e3-4a55-8760-22671d279ef0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:25.314427 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-28722822-30e3-4a55-8760-22671d279ef0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:25.317569 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-4d484517-2edd-4532-8cf1-0cf1f44b8b98 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:25.323865 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-28722822-30e3-4a55-8760-22671d279ef0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:25.325324 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-28722822-30e3-4a55-8760-22671d279ef0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:25.325676 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4d484517-2edd-4532-8cf1-0cf1f44b8b98 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.240524 Oct 06 12:33:25.326240 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 542/1087] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:25 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:25.326490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-28722822-30e3-4a55-8760-22671d279ef0 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.239774 Oct 06 12:33:25.327038 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 546/1088] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:25 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:33:26.349783 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b9e155e1-0ef4-42a4-b798-b8a820dfaf09 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:26.350385 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b9e155e1-0ef4-42a4-b798-b8a820dfaf09 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:26.351419 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c6a7bf49-dcfb-49c8-a52a-ad54f013fb43 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:26.352073 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c6a7bf49-dcfb-49c8-a52a-ad54f013fb43 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:26.357011 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b9e155e1-0ef4-42a4-b798-b8a820dfaf09 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:26.357493 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b9e155e1-0ef4-42a4-b798-b8a820dfaf09 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:26.357921 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b9e155e1-0ef4-42a4-b798-b8a820dfaf09 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:26.358603 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b9e155e1-0ef4-42a4-b798-b8a820dfaf09 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:26.358889 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6a7bf49-dcfb-49c8-a52a-ad54f013fb43 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:26.359052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b9e155e1-0ef4-42a4-b798-b8a820dfaf09 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:26.359370 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6a7bf49-dcfb-49c8-a52a-ad54f013fb43 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:26.359494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b9e155e1-0ef4-42a4-b798-b8a820dfaf09 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:26.359837 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6a7bf49-dcfb-49c8-a52a-ad54f013fb43 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:26.360528 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6a7bf49-dcfb-49c8-a52a-ad54f013fb43 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:26.360985 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6a7bf49-dcfb-49c8-a52a-ad54f013fb43 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:26.361408 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6a7bf49-dcfb-49c8-a52a-ad54f013fb43 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:26.550563 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b9e155e1-0ef4-42a4-b798-b8a820dfaf09 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:26.554453 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c6a7bf49-dcfb-49c8-a52a-ad54f013fb43 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:26.558872 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b9e155e1-0ef4-42a4-b798-b8a820dfaf09 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.212985 Oct 06 12:33:26.559448 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 543/1089] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:26 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:26.563122 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c6a7bf49-dcfb-49c8-a52a-ad54f013fb43 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:26.564593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c6a7bf49-dcfb-49c8-a52a-ad54f013fb43 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:26.565741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c6a7bf49-dcfb-49c8-a52a-ad54f013fb43 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.218180 Oct 06 12:33:26.566280 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 547/1090] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:26 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:33:27.581593 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b3312789-b7db-4903-ae57-5857ddc83a14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:27.582167 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b3312789-b7db-4903-ae57-5857ddc83a14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:27.588620 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b3312789-b7db-4903-ae57-5857ddc83a14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:27.589196 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b3312789-b7db-4903-ae57-5857ddc83a14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:27.589635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b3312789-b7db-4903-ae57-5857ddc83a14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:27.590325 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b3312789-b7db-4903-ae57-5857ddc83a14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:27.590776 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b3312789-b7db-4903-ae57-5857ddc83a14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:27.591199 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b3312789-b7db-4903-ae57-5857ddc83a14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:27.591335 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-135ace38-a523-4248-9206-b832d98ebfbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:27.591982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-135ace38-a523-4248-9206-b832d98ebfbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:27.598280 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-135ace38-a523-4248-9206-b832d98ebfbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:27.598768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-135ace38-a523-4248-9206-b832d98ebfbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:27.599235 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-135ace38-a523-4248-9206-b832d98ebfbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:27.599959 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-135ace38-a523-4248-9206-b832d98ebfbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:27.600419 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-135ace38-a523-4248-9206-b832d98ebfbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:27.600850 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-135ace38-a523-4248-9206-b832d98ebfbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:27.777397 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b3312789-b7db-4903-ae57-5857ddc83a14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:27.785227 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b3312789-b7db-4903-ae57-5857ddc83a14 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.207654 Oct 06 12:33:27.785801 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 544/1091] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:27 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:27.791370 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-135ace38-a523-4248-9206-b832d98ebfbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:27.799515 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-135ace38-a523-4248-9206-b832d98ebfbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:27.800959 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-135ace38-a523-4248-9206-b832d98ebfbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:27.802147 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-135ace38-a523-4248-9206-b832d98ebfbb tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.214868 Oct 06 12:33:27.802701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 548/1092] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:27 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:33:28.808241 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-cde22a87-12d7-400f-8af6-050449054d94 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:28.808851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-cde22a87-12d7-400f-8af6-050449054d94 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:28.815203 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cde22a87-12d7-400f-8af6-050449054d94 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:28.815729 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cde22a87-12d7-400f-8af6-050449054d94 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:28.816164 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cde22a87-12d7-400f-8af6-050449054d94 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:28.816843 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cde22a87-12d7-400f-8af6-050449054d94 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:28.817296 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cde22a87-12d7-400f-8af6-050449054d94 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:28.817718 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cde22a87-12d7-400f-8af6-050449054d94 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:28.827904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b0a9d95a-82e0-47f5-b81f-152f37410fc2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:28.828517 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b0a9d95a-82e0-47f5-b81f-152f37410fc2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:28.834719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b0a9d95a-82e0-47f5-b81f-152f37410fc2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:28.835196 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b0a9d95a-82e0-47f5-b81f-152f37410fc2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:28.835653 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b0a9d95a-82e0-47f5-b81f-152f37410fc2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:28.836339 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b0a9d95a-82e0-47f5-b81f-152f37410fc2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:28.836789 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b0a9d95a-82e0-47f5-b81f-152f37410fc2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:28.837212 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b0a9d95a-82e0-47f5-b81f-152f37410fc2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:28.997104 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-cde22a87-12d7-400f-8af6-050449054d94 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:29.004894 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-cde22a87-12d7-400f-8af6-050449054d94 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.200556 Oct 06 12:33:29.005556 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 545/1093] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:28 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:29.017874 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b0a9d95a-82e0-47f5-b81f-152f37410fc2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:29.026148 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b0a9d95a-82e0-47f5-b81f-152f37410fc2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:29.027904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b0a9d95a-82e0-47f5-b81f-152f37410fc2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:29.029078 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b0a9d95a-82e0-47f5-b81f-152f37410fc2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.205066 Oct 06 12:33:29.029645 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 549/1094] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:28 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:33:30.029086 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f7a3b5e2-010c-40d2-b9a5-37376c3aa81f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:30.029679 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f7a3b5e2-010c-40d2-b9a5-37376c3aa81f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:30.036026 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f7a3b5e2-010c-40d2-b9a5-37376c3aa81f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:30.036503 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f7a3b5e2-010c-40d2-b9a5-37376c3aa81f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:30.036933 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f7a3b5e2-010c-40d2-b9a5-37376c3aa81f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:30.037607 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f7a3b5e2-010c-40d2-b9a5-37376c3aa81f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:30.038055 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f7a3b5e2-010c-40d2-b9a5-37376c3aa81f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:30.038472 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f7a3b5e2-010c-40d2-b9a5-37376c3aa81f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:30.053862 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7f814645-ff4e-43d8-8094-740f4c51b60d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:30.054481 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7f814645-ff4e-43d8-8094-740f4c51b60d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:30.060753 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f814645-ff4e-43d8-8094-740f4c51b60d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:30.061242 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f814645-ff4e-43d8-8094-740f4c51b60d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:30.061683 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f814645-ff4e-43d8-8094-740f4c51b60d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:30.062376 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f814645-ff4e-43d8-8094-740f4c51b60d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:30.062833 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f814645-ff4e-43d8-8094-740f4c51b60d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:30.063266 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7f814645-ff4e-43d8-8094-740f4c51b60d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:30.229432 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f7a3b5e2-010c-40d2-b9a5-37376c3aa81f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:30.237058 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f7a3b5e2-010c-40d2-b9a5-37376c3aa81f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.212655 Oct 06 12:33:30.237906 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 546/1095] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:30 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:30.241103 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7f814645-ff4e-43d8-8094-740f4c51b60d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:30.249923 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7f814645-ff4e-43d8-8094-740f4c51b60d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:30.251344 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7f814645-ff4e-43d8-8094-740f4c51b60d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:30.252556 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7f814645-ff4e-43d8-8094-740f4c51b60d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.202549 Oct 06 12:33:30.253120 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 550/1096] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:30 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:33:31.259914 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-11a3f73c-5067-4b42-a653-5d69030ac4a6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:31.261116 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-11a3f73c-5067-4b42-a653-5d69030ac4a6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:31.267424 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11a3f73c-5067-4b42-a653-5d69030ac4a6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:31.267932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11a3f73c-5067-4b42-a653-5d69030ac4a6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:31.268360 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11a3f73c-5067-4b42-a653-5d69030ac4a6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:31.269036 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11a3f73c-5067-4b42-a653-5d69030ac4a6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:31.269484 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11a3f73c-5067-4b42-a653-5d69030ac4a6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:31.269904 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11a3f73c-5067-4b42-a653-5d69030ac4a6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:31.277969 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-08958b39-9f7b-464d-a256-700206e5c750 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:31.278582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-08958b39-9f7b-464d-a256-700206e5c750 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:31.288422 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08958b39-9f7b-464d-a256-700206e5c750 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:31.288922 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08958b39-9f7b-464d-a256-700206e5c750 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:31.289362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08958b39-9f7b-464d-a256-700206e5c750 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:31.294129 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08958b39-9f7b-464d-a256-700206e5c750 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:31.294129 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08958b39-9f7b-464d-a256-700206e5c750 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:31.294129 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-08958b39-9f7b-464d-a256-700206e5c750 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:31.466652 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-11a3f73c-5067-4b42-a653-5d69030ac4a6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:31.475419 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-11a3f73c-5067-4b42-a653-5d69030ac4a6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.219266 Oct 06 12:33:31.476310 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 547/1097] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:31 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:31.481926 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-08958b39-9f7b-464d-a256-700206e5c750 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:31.490466 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-08958b39-9f7b-464d-a256-700206e5c750 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:31.492043 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-08958b39-9f7b-464d-a256-700206e5c750 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:31.493287 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-08958b39-9f7b-464d-a256-700206e5c750 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.219429 Oct 06 12:33:31.494060 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 551/1098] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:31 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:33:32.498254 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ef21f622-dbb5-46dd-9f60-b9d25786b9c6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:32.498774 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ef21f622-dbb5-46dd-9f60-b9d25786b9c6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:32.505468 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ef21f622-dbb5-46dd-9f60-b9d25786b9c6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:32.505955 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ef21f622-dbb5-46dd-9f60-b9d25786b9c6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:32.506392 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ef21f622-dbb5-46dd-9f60-b9d25786b9c6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:32.507086 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ef21f622-dbb5-46dd-9f60-b9d25786b9c6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:32.507567 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ef21f622-dbb5-46dd-9f60-b9d25786b9c6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:32.507997 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ef21f622-dbb5-46dd-9f60-b9d25786b9c6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:32.521272 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d9cc20a3-2f38-49c2-b157-ced8e35b5f01 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:32.523106 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d9cc20a3-2f38-49c2-b157-ced8e35b5f01 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:32.531343 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=100 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:32.533577 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9cc20a3-2f38-49c2-b157-ced8e35b5f01 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:32.534127 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9cc20a3-2f38-49c2-b157-ced8e35b5f01 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:32.534566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9cc20a3-2f38-49c2-b157-ced8e35b5f01 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:32.535276 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9cc20a3-2f38-49c2-b157-ced8e35b5f01 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:32.535757 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9cc20a3-2f38-49c2-b157-ced8e35b5f01 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:32.536183 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9cc20a3-2f38-49c2-b157-ced8e35b5f01 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:32.776829 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ef21f622-dbb5-46dd-9f60-b9d25786b9c6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:32.784762 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ef21f622-dbb5-46dd-9f60-b9d25786b9c6 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.290547 Oct 06 12:33:32.785327 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 548/1099] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:32 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:32.790392 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d9cc20a3-2f38-49c2-b157-ced8e35b5f01 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:32.798509 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d9cc20a3-2f38-49c2-b157-ced8e35b5f01 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:32.800085 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d9cc20a3-2f38-49c2-b157-ced8e35b5f01 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:32.801244 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d9cc20a3-2f38-49c2-b157-ced8e35b5f01 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.285190 Oct 06 12:33:32.801803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 552/1100] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:32 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:33:33.808526 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4b03e5d7-40a6-4eb1-9d6e-9e34656b487a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:33.809151 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-4b03e5d7-40a6-4eb1-9d6e-9e34656b487a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:33.816823 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4b03e5d7-40a6-4eb1-9d6e-9e34656b487a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:33.817522 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4b03e5d7-40a6-4eb1-9d6e-9e34656b487a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:33.818115 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4b03e5d7-40a6-4eb1-9d6e-9e34656b487a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:33.818948 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4b03e5d7-40a6-4eb1-9d6e-9e34656b487a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:33.819417 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4b03e5d7-40a6-4eb1-9d6e-9e34656b487a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:33.819883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-4b03e5d7-40a6-4eb1-9d6e-9e34656b487a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:33.851043 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-62b2027d-3bc1-46cf-9b21-2d5254dfcfec req-17d803f4-34ef-4c5d-b53d-bc86ad395369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621f2a35-3a2e-4b6f-af2b-67399b85d360", "name": "network-vif-plugged", "status": "completed", "tag": "09838f9f-3bca-496d-a61f-cacc2bc37a5d"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:33:33.860881 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-62b2027d-3bc1-46cf-9b21-2d5254dfcfec req-17d803f4-34ef-4c5d-b53d-bc86ad395369 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:33.861462 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-62b2027d-3bc1-46cf-9b21-2d5254dfcfec req-17d803f4-34ef-4c5d-b53d-bc86ad395369 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:33.861963 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-62b2027d-3bc1-46cf-9b21-2d5254dfcfec req-17d803f4-34ef-4c5d-b53d-bc86ad395369 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:33.877412 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-62b2027d-3bc1-46cf-9b21-2d5254dfcfec req-17d803f4-34ef-4c5d-b53d-bc86ad395369 service nova] Creating event network-vif-plugged:09838f9f-3bca-496d-a61f-cacc2bc37a5d for instance 621f2a35-3a2e-4b6f-af2b-67399b85d360 on hv-cinder-85604 Oct 06 12:33:33.882514 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-62b2027d-3bc1-46cf-9b21-2d5254dfcfec req-17d803f4-34ef-4c5d-b53d-bc86ad395369 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097254 Oct 06 12:33:33.883189 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 549/1101] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:33:33.889009 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-01df02eb-39d1-4ea9-a483-472d14494d3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:33.890330 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-01df02eb-39d1-4ea9-a483-472d14494d3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:33.896641 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-01df02eb-39d1-4ea9-a483-472d14494d3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:33.897116 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-01df02eb-39d1-4ea9-a483-472d14494d3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:33.897744 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-01df02eb-39d1-4ea9-a483-472d14494d3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:33.898445 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-01df02eb-39d1-4ea9-a483-472d14494d3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:33.898896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-01df02eb-39d1-4ea9-a483-472d14494d3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:33.899310 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-01df02eb-39d1-4ea9-a483-472d14494d3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:34.007187 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-4b03e5d7-40a6-4eb1-9d6e-9e34656b487a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:34.015404 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4b03e5d7-40a6-4eb1-9d6e-9e34656b487a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.211661 Oct 06 12:33:34.016236 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 553/1102] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:33 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:34.055923 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-01df02eb-39d1-4ea9-a483-472d14494d3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:34.064626 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-01df02eb-39d1-4ea9-a483-472d14494d3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:34.066308 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-01df02eb-39d1-4ea9-a483-472d14494d3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:34.067471 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-01df02eb-39d1-4ea9-a483-472d14494d3a tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.182916 Oct 06 12:33:34.068169 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 550/1103] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:33 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:35.039568 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-99b4cb76-70df-45e8-9ca3-064211dadde5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:35.040184 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-99b4cb76-70df-45e8-9ca3-064211dadde5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:35.047015 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-99b4cb76-70df-45e8-9ca3-064211dadde5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:35.047499 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-99b4cb76-70df-45e8-9ca3-064211dadde5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:35.047960 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-99b4cb76-70df-45e8-9ca3-064211dadde5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:35.048671 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-99b4cb76-70df-45e8-9ca3-064211dadde5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:35.049124 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-99b4cb76-70df-45e8-9ca3-064211dadde5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:35.049544 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-99b4cb76-70df-45e8-9ca3-064211dadde5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:35.053450 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=100 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:35.093557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9ae882cc-b5fc-4887-aaf7-390292eddce3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:35.094258 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9ae882cc-b5fc-4887-aaf7-390292eddce3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:35.101201 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9ae882cc-b5fc-4887-aaf7-390292eddce3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:35.101691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9ae882cc-b5fc-4887-aaf7-390292eddce3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:35.102126 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9ae882cc-b5fc-4887-aaf7-390292eddce3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:35.102819 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9ae882cc-b5fc-4887-aaf7-390292eddce3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:35.103271 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9ae882cc-b5fc-4887-aaf7-390292eddce3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:35.103727 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9ae882cc-b5fc-4887-aaf7-390292eddce3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:35.222282 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-99b4cb76-70df-45e8-9ca3-064211dadde5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:35.230565 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-99b4cb76-70df-45e8-9ca3-064211dadde5 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1266 microversion: 2.1 time: 0.194794 Oct 06 12:33:35.231148 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 554/1104] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:35 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:35.268796 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9ae882cc-b5fc-4887-aaf7-390292eddce3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:35.277592 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9ae882cc-b5fc-4887-aaf7-390292eddce3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:35.279017 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9ae882cc-b5fc-4887-aaf7-390292eddce3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:35.280188 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9ae882cc-b5fc-4887-aaf7-390292eddce3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.190497 Oct 06 12:33:35.280748 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 551/1105] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:35 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:33:35.902924 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-3a1d9ad8-0c3b-42ae-9647-320772446f43 req-e1102f37-15a9-43e7-967d-b30f5ed4588b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c743b80a-43e9-4dc1-a570-6873a5992f34", "name": "network-vif-plugged", "status": "completed", "tag": "fc7be519-3630-4616-ad76-14402cf4ad87"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:33:35.912164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-3a1d9ad8-0c3b-42ae-9647-320772446f43 req-e1102f37-15a9-43e7-967d-b30f5ed4588b service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:35.912649 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-3a1d9ad8-0c3b-42ae-9647-320772446f43 req-e1102f37-15a9-43e7-967d-b30f5ed4588b service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:35.913078 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-3a1d9ad8-0c3b-42ae-9647-320772446f43 req-e1102f37-15a9-43e7-967d-b30f5ed4588b service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:35.924175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-3a1d9ad8-0c3b-42ae-9647-320772446f43 req-e1102f37-15a9-43e7-967d-b30f5ed4588b service nova] Creating event network-vif-plugged:fc7be519-3630-4616-ad76-14402cf4ad87 for instance c743b80a-43e9-4dc1-a570-6873a5992f34 on hv-cinder-85604 Oct 06 12:33:35.929033 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-3a1d9ad8-0c3b-42ae-9647-320772446f43 req-e1102f37-15a9-43e7-967d-b30f5ed4588b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030104 Oct 06 12:33:35.929581 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 555/1106] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:33:36.254258 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7b9ca00a-ceb5-4f18-87ba-55d91eddc74d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:36.254875 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7b9ca00a-ceb5-4f18-87ba-55d91eddc74d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:36.261676 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7b9ca00a-ceb5-4f18-87ba-55d91eddc74d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:36.262097 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7b9ca00a-ceb5-4f18-87ba-55d91eddc74d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:36.262521 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7b9ca00a-ceb5-4f18-87ba-55d91eddc74d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:36.263203 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7b9ca00a-ceb5-4f18-87ba-55d91eddc74d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:36.263685 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7b9ca00a-ceb5-4f18-87ba-55d91eddc74d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:36.264251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7b9ca00a-ceb5-4f18-87ba-55d91eddc74d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:36.305434 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b2f1faae-6992-493b-bb3e-99f88e1070e3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:36.306126 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b2f1faae-6992-493b-bb3e-99f88e1070e3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:36.312626 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b2f1faae-6992-493b-bb3e-99f88e1070e3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:36.313115 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b2f1faae-6992-493b-bb3e-99f88e1070e3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:36.313554 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b2f1faae-6992-493b-bb3e-99f88e1070e3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:36.314249 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b2f1faae-6992-493b-bb3e-99f88e1070e3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:36.314702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b2f1faae-6992-493b-bb3e-99f88e1070e3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:36.315128 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b2f1faae-6992-493b-bb3e-99f88e1070e3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:36.730763 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7b9ca00a-ceb5-4f18-87ba-55d91eddc74d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:36.738422 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7b9ca00a-ceb5-4f18-87ba-55d91eddc74d tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1452 microversion: 2.1 time: 0.488420 Oct 06 12:33:36.739005 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 552/1107] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:36 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1452 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:33:36.760409 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-10e418d7-bdff-4af1-a3b5-e4beeedf21bf tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:36.761590 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-10e418d7-bdff-4af1-a3b5-e4beeedf21bf tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:36.767341 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-10e418d7-bdff-4af1-a3b5-e4beeedf21bf tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:36.767894 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-10e418d7-bdff-4af1-a3b5-e4beeedf21bf tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:36.768336 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-10e418d7-bdff-4af1-a3b5-e4beeedf21bf tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:36.769030 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-10e418d7-bdff-4af1-a3b5-e4beeedf21bf tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:36.769487 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-10e418d7-bdff-4af1-a3b5-e4beeedf21bf tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:36.769911 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-10e418d7-bdff-4af1-a3b5-e4beeedf21bf tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:36.771496 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b2f1faae-6992-493b-bb3e-99f88e1070e3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:36.780505 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b2f1faae-6992-493b-bb3e-99f88e1070e3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:36.781953 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b2f1faae-6992-493b-bb3e-99f88e1070e3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:36.783119 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b2f1faae-6992-493b-bb3e-99f88e1070e3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.481816 Oct 06 12:33:36.783708 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 556/1108] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:36 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:33:36.901779 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-10e418d7-bdff-4af1-a3b5-e4beeedf21bf tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:36.909649 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-10e418d7-bdff-4af1-a3b5-e4beeedf21bf tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1452 microversion: 2.1 time: 0.152905 Oct 06 12:33:36.910223 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 553/1109] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:33:36 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:33:37.808458 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b186a15d-2de5-4e2a-b687-6ae96d7849dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:37.809181 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b186a15d-2de5-4e2a-b687-6ae96d7849dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:37.815640 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b186a15d-2de5-4e2a-b687-6ae96d7849dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:37.816130 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b186a15d-2de5-4e2a-b687-6ae96d7849dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:37.816571 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b186a15d-2de5-4e2a-b687-6ae96d7849dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:37.817270 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b186a15d-2de5-4e2a-b687-6ae96d7849dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:37.817728 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b186a15d-2de5-4e2a-b687-6ae96d7849dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:37.818156 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b186a15d-2de5-4e2a-b687-6ae96d7849dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:38.028161 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b186a15d-2de5-4e2a-b687-6ae96d7849dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:38.036772 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b186a15d-2de5-4e2a-b687-6ae96d7849dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:38.038235 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b186a15d-2de5-4e2a-b687-6ae96d7849dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:38.039411 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b186a15d-2de5-4e2a-b687-6ae96d7849dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.234861 Oct 06 12:33:38.040020 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 557/1110] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:37 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:33:38.614989 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-b80503bc-fbab-433f-ba06-6bfc92fea475 req-10a18657-0512-4ff9-8044-3d3799b11c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "621f2a35-3a2e-4b6f-af2b-67399b85d360", "tag": "09838f9f-3bca-496d-a61f-cacc2bc37a5d"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:33:38.624781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-b80503bc-fbab-433f-ba06-6bfc92fea475 req-10a18657-0512-4ff9-8044-3d3799b11c83 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:38.625250 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-b80503bc-fbab-433f-ba06-6bfc92fea475 req-10a18657-0512-4ff9-8044-3d3799b11c83 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:38.625670 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-b80503bc-fbab-433f-ba06-6bfc92fea475 req-10a18657-0512-4ff9-8044-3d3799b11c83 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:38.637582 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-b80503bc-fbab-433f-ba06-6bfc92fea475 req-10a18657-0512-4ff9-8044-3d3799b11c83 service nova] Creating event network-changed:09838f9f-3bca-496d-a61f-cacc2bc37a5d for instance 621f2a35-3a2e-4b6f-af2b-67399b85d360 on hv-cinder-85604 Oct 06 12:33:38.642426 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-b80503bc-fbab-433f-ba06-6bfc92fea475 req-10a18657-0512-4ff9-8044-3d3799b11c83 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031020 Oct 06 12:33:38.643670 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 554/1111] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:33:39.067017 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b3d0b282-f7d2-477a-8016-0464f5f75373 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:39.068891 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b3d0b282-f7d2-477a-8016-0464f5f75373 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:39.077772 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b3d0b282-f7d2-477a-8016-0464f5f75373 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:39.079274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b3d0b282-f7d2-477a-8016-0464f5f75373 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:39.079790 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b3d0b282-f7d2-477a-8016-0464f5f75373 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:39.080751 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b3d0b282-f7d2-477a-8016-0464f5f75373 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:39.081451 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b3d0b282-f7d2-477a-8016-0464f5f75373 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:39.082238 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b3d0b282-f7d2-477a-8016-0464f5f75373 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:39.299333 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b3d0b282-f7d2-477a-8016-0464f5f75373 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:39.307370 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b3d0b282-f7d2-477a-8016-0464f5f75373 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:39.308855 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b3d0b282-f7d2-477a-8016-0464f5f75373 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:39.310022 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b3d0b282-f7d2-477a-8016-0464f5f75373 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1729 microversion: 2.20 time: 0.249276 Oct 06 12:33:39.310594 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 558/1112] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:39 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:33:40.336167 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ddbdf7d6-d6be-4987-aeec-b32837eac5dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:33:40.336864 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ddbdf7d6-d6be-4987-aeec-b32837eac5dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:33:40.343605 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ddbdf7d6-d6be-4987-aeec-b32837eac5dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:40.344108 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ddbdf7d6-d6be-4987-aeec-b32837eac5dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:40.344548 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ddbdf7d6-d6be-4987-aeec-b32837eac5dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:40.345234 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ddbdf7d6-d6be-4987-aeec-b32837eac5dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:33:40.345805 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ddbdf7d6-d6be-4987-aeec-b32837eac5dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:33:40.346243 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ddbdf7d6-d6be-4987-aeec-b32837eac5dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:33:40.475431 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ddbdf7d6-d6be-4987-aeec-b32837eac5dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:40.483636 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ddbdf7d6-d6be-4987-aeec-b32837eac5dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:40.485087 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ddbdf7d6-d6be-4987-aeec-b32837eac5dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:33:40.486239 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ddbdf7d6-d6be-4987-aeec-b32837eac5dc tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1716 microversion: 2.20 time: 0.154906 Oct 06 12:33:40.486805 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 555/1113] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:33:40 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:34:29.780056 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-542db87e-13df-4c95-917d-437f3b8904b0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:29.780652 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-542db87e-13df-4c95-917d-437f3b8904b0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:29.782864 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=47 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:34:29.783562 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=24 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:34:29.784915 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 12:34:29.785061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Thu Oct 6 12:34:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608/ips (ip 10.222.0.33) !!! Oct 06 12:34:29.792312 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-542db87e-13df-4c95-917d-437f3b8904b0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:29.792790 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-542db87e-13df-4c95-917d-437f3b8904b0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:29.793225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-542db87e-13df-4c95-917d-437f3b8904b0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:29.793916 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-542db87e-13df-4c95-917d-437f3b8904b0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:29.794368 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-542db87e-13df-4c95-917d-437f3b8904b0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:29.794787 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-542db87e-13df-4c95-917d-437f3b8904b0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:29.818870 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-542db87e-13df-4c95-917d-437f3b8904b0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608/ips" status: 200 len: 150 microversion: 2.1 time: 0.043580 Oct 06 12:34:29.819431 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 559/1114] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 12:34:29 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:34:31.172090 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b8f7f99c-a96c-440f-8bcf-d997dacfa3fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91767071-c90c-460d-8792-2e4fb744d4c4"}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:34:31.174593 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b8f7f99c-a96c-440f-8bcf-d997dacfa3fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:31.176956 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=55 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:34:31.177603 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=36 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:34:31.184459 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b8f7f99c-a96c-440f-8bcf-d997dacfa3fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:31.184938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b8f7f99c-a96c-440f-8bcf-d997dacfa3fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:31.185368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b8f7f99c-a96c-440f-8bcf-d997dacfa3fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:31.186378 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b8f7f99c-a96c-440f-8bcf-d997dacfa3fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:31.186832 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b8f7f99c-a96c-440f-8bcf-d997dacfa3fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:31.187251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b8f7f99c-a96c-440f-8bcf-d997dacfa3fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:31.464563 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b8f7f99c-a96c-440f-8bcf-d997dacfa3fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "POST /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296548 Oct 06 12:34:31.465452 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 556/1115] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 12:34:31 2022] POST /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:34:38.993447 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-4983425e-97f7-42c9-8509-3fca6017dbcd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Action: 'create', calling method: .version_select at 0x7f03ae2e1ee0>, body: {"keypair": {"name": "tempest-keypair-1500408061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrjRJzqdBZXqBzMjF1BMY3EPik6OPrqlxnJe87lF05Ziwi6wW6YjMm3S+5xiBAyRcRj7XRTcEQlR6FC6uCEUjd2u5xCBDBi+0UHARPc5Xc7zdUcoMMHrtXBzbamHymAZA=="}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:34:39.009448 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-4983425e-97f7-42c9-8509-3fca6017dbcd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'key_pairs'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:34:39.013749 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-4983425e-97f7-42c9-8509-3fca6017dbcd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for user 404c5e2b85454e1e91b90fa45796511e and project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'key_pairs'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:34:39.037453 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-4983425e-97f7-42c9-8509-3fca6017dbcd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047799 Oct 06 12:34:39.038034 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 560/1116] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 12:34:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:34:40.450737 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1667914460", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "466556a2-70ae-47ab-beee-c79927eef272"}], "security_groups": [{"name": "tempest-securitygroup--1957865100"}], "key_name": "tempest-keypair-1500408061", "user_data": "}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:34:40.555076 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.network.neutron [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] validate_networks() for [('466556a2-70ae-47ab-beee-c79927eef272', None, None, None, None, None)] {{(pid=120509) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:34:40.920851 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Flavor limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:34:40.921269 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Image limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:34:40.921738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Flavor pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:34:40.922143 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Image pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:34:40.922550 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:34:40.931188 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:40.931707 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:40.932140 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:40.932848 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:40.933294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:40.934286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:40.950257 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:34:40.954097 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for user 404c5e2b85454e1e91b90fa45796511e and project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:34:40.964786 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Going to run 1 instances... {{(pid=120509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:34:40.967112 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:34:41.013536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-03c0a940-5cbb-4472-8c1a-0e816ab74acf tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.568522 Oct 06 12:34:41.014186 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 557/1117] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:34:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:34:41.022057 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=4 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:34:41.027256 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c05f630a-fc54-4648-8632-b590ebdb8cb4 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:41.027966 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c05f630a-fc54-4648-8632-b590ebdb8cb4 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:41.082514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c05f630a-fc54-4648-8632-b590ebdb8cb4 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:41.089475 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c05f630a-fc54-4648-8632-b590ebdb8cb4 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 200 len: 1242 microversion: 2.1 time: 0.068152 Oct 06 12:34:41.090616 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 561/1118] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:34:41 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:34:42.115175 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e2ed6b5b-7328-4c53-94de-6edc87b5cc89 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:42.115873 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e2ed6b5b-7328-4c53-94de-6edc87b5cc89 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:42.123396 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2ed6b5b-7328-4c53-94de-6edc87b5cc89 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:42.123908 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2ed6b5b-7328-4c53-94de-6edc87b5cc89 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:42.124342 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2ed6b5b-7328-4c53-94de-6edc87b5cc89 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:42.125030 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2ed6b5b-7328-4c53-94de-6edc87b5cc89 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:42.125477 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2ed6b5b-7328-4c53-94de-6edc87b5cc89 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:42.125900 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2ed6b5b-7328-4c53-94de-6edc87b5cc89 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:42.232863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e2ed6b5b-7328-4c53-94de-6edc87b5cc89 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:42.247179 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e2ed6b5b-7328-4c53-94de-6edc87b5cc89 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 200 len: 1302 microversion: 2.1 time: 0.136192 Oct 06 12:34:42.252380 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 558/1119] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:34:42 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 1302 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:34:43.270111 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d238f458-6fde-4037-b3e9-db9926605ece tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:43.270723 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d238f458-6fde-4037-b3e9-db9926605ece tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:43.277029 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d238f458-6fde-4037-b3e9-db9926605ece tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:43.278084 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d238f458-6fde-4037-b3e9-db9926605ece tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:43.278531 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d238f458-6fde-4037-b3e9-db9926605ece tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:43.279347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d238f458-6fde-4037-b3e9-db9926605ece tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:43.280083 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d238f458-6fde-4037-b3e9-db9926605ece tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:43.280505 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d238f458-6fde-4037-b3e9-db9926605ece tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:43.516227 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d238f458-6fde-4037-b3e9-db9926605ece tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:43.523875 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d238f458-6fde-4037-b3e9-db9926605ece tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 200 len: 1368 microversion: 2.1 time: 0.257621 Oct 06 12:34:43.524449 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 562/1120] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:34:43 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:34:43.713923 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-c1762ce5-690f-4041-9e73-a2eb84d3cddb req-abd4224b-0c90-4f94-aa65-530e557634f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aae47f4-74e0-47ee-8859-407ff1e7a221", "tag": "df8efaa3-7d04-48a0-a529-0bdb59ee2149"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:34:43.724420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-c1762ce5-690f-4041-9e73-a2eb84d3cddb req-abd4224b-0c90-4f94-aa65-530e557634f5 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:43.725034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-c1762ce5-690f-4041-9e73-a2eb84d3cddb req-abd4224b-0c90-4f94-aa65-530e557634f5 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:43.725580 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-c1762ce5-690f-4041-9e73-a2eb84d3cddb req-abd4224b-0c90-4f94-aa65-530e557634f5 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:43.739467 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-c1762ce5-690f-4041-9e73-a2eb84d3cddb req-abd4224b-0c90-4f94-aa65-530e557634f5 service nova] Creating event network-changed:df8efaa3-7d04-48a0-a529-0bdb59ee2149 for instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 on hv-cinder-85604 Oct 06 12:34:43.744442 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-c1762ce5-690f-4041-9e73-a2eb84d3cddb req-abd4224b-0c90-4f94-aa65-530e557634f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034338 Oct 06 12:34:43.745166 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 559/1121] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:34:44.425217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-fd02c992-dd7c-4339-a978-902b27e0f23f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:44.427468 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-fd02c992-dd7c-4339-a978-902b27e0f23f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:44.434577 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fd02c992-dd7c-4339-a978-902b27e0f23f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:44.435067 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fd02c992-dd7c-4339-a978-902b27e0f23f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:44.435523 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fd02c992-dd7c-4339-a978-902b27e0f23f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:44.436254 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fd02c992-dd7c-4339-a978-902b27e0f23f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:44.436716 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fd02c992-dd7c-4339-a978-902b27e0f23f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:44.437149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fd02c992-dd7c-4339-a978-902b27e0f23f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:44.467312 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-fd02c992-dd7c-4339-a978-902b27e0f23f tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046069 Oct 06 12:34:44.467900 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 563/1122] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Oct 6 12:34:44 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:34:44.530232 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-67bdf8a4-2b5b-4fec-8b73-b8143bdfa72d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:44.530814 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-67bdf8a4-2b5b-4fec-8b73-b8143bdfa72d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:44.536845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-67bdf8a4-2b5b-4fec-8b73-b8143bdfa72d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:44.537317 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-67bdf8a4-2b5b-4fec-8b73-b8143bdfa72d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:44.537755 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-67bdf8a4-2b5b-4fec-8b73-b8143bdfa72d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:44.538430 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-67bdf8a4-2b5b-4fec-8b73-b8143bdfa72d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:44.538879 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-67bdf8a4-2b5b-4fec-8b73-b8143bdfa72d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:44.539296 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-67bdf8a4-2b5b-4fec-8b73-b8143bdfa72d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:44.546621 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-623638ba-146b-4215-9f3e-247c92b0a299 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:44.547216 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-623638ba-146b-4215-9f3e-247c92b0a299 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:44.552958 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-623638ba-146b-4215-9f3e-247c92b0a299 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:44.553437 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-623638ba-146b-4215-9f3e-247c92b0a299 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:44.553867 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-623638ba-146b-4215-9f3e-247c92b0a299 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:44.554547 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-623638ba-146b-4215-9f3e-247c92b0a299 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:44.554998 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-623638ba-146b-4215-9f3e-247c92b0a299 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:44.555418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-623638ba-146b-4215-9f3e-247c92b0a299 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:44.564760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-67bdf8a4-2b5b-4fec-8b73-b8143bdfa72d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Going to try to terminate instance {{(pid=120509) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:34:44.640545 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-67bdf8a4-2b5b-4fec-8b73-b8143bdfa72d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 204 len: 0 microversion: 2.20 time: 0.114583 Oct 06 12:34:44.641382 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 560/1123] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Oct 6 12:34:44 2022] DELETE /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:34:44.649678 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-832952ef-aad1-4ea3-95b6-5f14ffa84c93 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:44.650366 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-832952ef-aad1-4ea3-95b6-5f14ffa84c93 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:44.656464 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-832952ef-aad1-4ea3-95b6-5f14ffa84c93 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:44.656942 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-832952ef-aad1-4ea3-95b6-5f14ffa84c93 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:44.657378 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-832952ef-aad1-4ea3-95b6-5f14ffa84c93 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:44.658065 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-832952ef-aad1-4ea3-95b6-5f14ffa84c93 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:44.658520 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-832952ef-aad1-4ea3-95b6-5f14ffa84c93 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:44.658937 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-832952ef-aad1-4ea3-95b6-5f14ffa84c93 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:44.689188 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-623638ba-146b-4215-9f3e-247c92b0a299 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:44.696971 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-623638ba-146b-4215-9f3e-247c92b0a299 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 200 len: 1368 microversion: 2.1 time: 0.154619 Oct 06 12:34:44.697539 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 564/1124] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:34:44 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:34:44.786356 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-832952ef-aad1-4ea3-95b6-5f14ffa84c93 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:44.794599 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-832952ef-aad1-4ea3-95b6-5f14ffa84c93 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:44.796071 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-832952ef-aad1-4ea3-95b6-5f14ffa84c93 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:44.797210 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-832952ef-aad1-4ea3-95b6-5f14ffa84c93 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.151588 Oct 06 12:34:44.797770 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 561/1125] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:34:44 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:34:45.720195 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-40eb0fb0-0264-4d00-938a-cfe2f82adcd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:45.720807 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-40eb0fb0-0264-4d00-938a-cfe2f82adcd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:45.727134 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-40eb0fb0-0264-4d00-938a-cfe2f82adcd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:45.727661 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-40eb0fb0-0264-4d00-938a-cfe2f82adcd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:45.728095 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-40eb0fb0-0264-4d00-938a-cfe2f82adcd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:45.728781 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-40eb0fb0-0264-4d00-938a-cfe2f82adcd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:45.729235 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-40eb0fb0-0264-4d00-938a-cfe2f82adcd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:45.729655 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-40eb0fb0-0264-4d00-938a-cfe2f82adcd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:45.830195 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d56ef1a9-81b3-425e-9b3c-9d8339076aa2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:45.830938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d56ef1a9-81b3-425e-9b3c-9d8339076aa2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:45.837344 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d56ef1a9-81b3-425e-9b3c-9d8339076aa2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:45.837905 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d56ef1a9-81b3-425e-9b3c-9d8339076aa2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:45.838347 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d56ef1a9-81b3-425e-9b3c-9d8339076aa2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:45.839033 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d56ef1a9-81b3-425e-9b3c-9d8339076aa2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:45.839480 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d56ef1a9-81b3-425e-9b3c-9d8339076aa2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:45.840436 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d56ef1a9-81b3-425e-9b3c-9d8339076aa2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:45.860204 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-40eb0fb0-0264-4d00-938a-cfe2f82adcd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:45.867757 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-40eb0fb0-0264-4d00-938a-cfe2f82adcd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 200 len: 1368 microversion: 2.1 time: 0.151382 Oct 06 12:34:45.868318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 565/1126] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:34:45 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:34:45.964876 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d56ef1a9-81b3-425e-9b3c-9d8339076aa2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:45.973565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d56ef1a9-81b3-425e-9b3c-9d8339076aa2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:45.974954 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d56ef1a9-81b3-425e-9b3c-9d8339076aa2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:45.976131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d56ef1a9-81b3-425e-9b3c-9d8339076aa2 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.149920 Oct 06 12:34:45.976689 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 562/1127] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:34:45 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:34:46.890781 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f951bbfd-0b52-40bf-8bd1-6882f6b7757b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:46.891756 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f951bbfd-0b52-40bf-8bd1-6882f6b7757b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:46.899540 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f951bbfd-0b52-40bf-8bd1-6882f6b7757b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:46.900033 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f951bbfd-0b52-40bf-8bd1-6882f6b7757b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:46.900484 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f951bbfd-0b52-40bf-8bd1-6882f6b7757b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:46.901220 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f951bbfd-0b52-40bf-8bd1-6882f6b7757b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:46.901682 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f951bbfd-0b52-40bf-8bd1-6882f6b7757b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:46.902114 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f951bbfd-0b52-40bf-8bd1-6882f6b7757b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:47.001133 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a83f87d4-c80f-4cdf-b70d-d99d5558ae7e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:47.001764 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a83f87d4-c80f-4cdf-b70d-d99d5558ae7e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:47.008350 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a83f87d4-c80f-4cdf-b70d-d99d5558ae7e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:47.008836 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a83f87d4-c80f-4cdf-b70d-d99d5558ae7e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:47.009273 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a83f87d4-c80f-4cdf-b70d-d99d5558ae7e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:47.009970 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a83f87d4-c80f-4cdf-b70d-d99d5558ae7e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:47.010424 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a83f87d4-c80f-4cdf-b70d-d99d5558ae7e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:47.010846 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a83f87d4-c80f-4cdf-b70d-d99d5558ae7e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:47.031145 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f951bbfd-0b52-40bf-8bd1-6882f6b7757b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:47.038766 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f951bbfd-0b52-40bf-8bd1-6882f6b7757b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 200 len: 1368 microversion: 2.1 time: 0.152259 Oct 06 12:34:47.039346 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 566/1128] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:34:46 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:34:47.135795 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a83f87d4-c80f-4cdf-b70d-d99d5558ae7e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:47.143816 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a83f87d4-c80f-4cdf-b70d-d99d5558ae7e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:47.145254 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a83f87d4-c80f-4cdf-b70d-d99d5558ae7e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:47.146397 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a83f87d4-c80f-4cdf-b70d-d99d5558ae7e tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.149816 Oct 06 12:34:47.146987 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 563/1129] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:34:46 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:34:48.062337 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-cf2948ce-6e21-4be0-921a-d393ced53e52 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:48.062959 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-cf2948ce-6e21-4be0-921a-d393ced53e52 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:48.069331 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cf2948ce-6e21-4be0-921a-d393ced53e52 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:48.069770 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cf2948ce-6e21-4be0-921a-d393ced53e52 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:48.070208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cf2948ce-6e21-4be0-921a-d393ced53e52 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:48.070911 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cf2948ce-6e21-4be0-921a-d393ced53e52 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:48.071367 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cf2948ce-6e21-4be0-921a-d393ced53e52 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:48.071818 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cf2948ce-6e21-4be0-921a-d393ced53e52 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:48.172985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-eca47250-c25c-45c2-8c66-0ad7a8c8ef99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:48.173684 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-eca47250-c25c-45c2-8c66-0ad7a8c8ef99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:48.180086 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-eca47250-c25c-45c2-8c66-0ad7a8c8ef99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:48.180644 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-eca47250-c25c-45c2-8c66-0ad7a8c8ef99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:48.181155 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-eca47250-c25c-45c2-8c66-0ad7a8c8ef99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:48.181936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-eca47250-c25c-45c2-8c66-0ad7a8c8ef99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:48.182462 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-eca47250-c25c-45c2-8c66-0ad7a8c8ef99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:48.182956 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-eca47250-c25c-45c2-8c66-0ad7a8c8ef99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:48.397397 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-cf2948ce-6e21-4be0-921a-d393ced53e52 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:48.406285 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-cf2948ce-6e21-4be0-921a-d393ced53e52 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 200 len: 1368 microversion: 2.1 time: 0.347881 Oct 06 12:34:48.406869 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 567/1130] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:34:48 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 1368 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:34:48.482240 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-eca47250-c25c-45c2-8c66-0ad7a8c8ef99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:48.490880 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-eca47250-c25c-45c2-8c66-0ad7a8c8ef99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:48.492467 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-eca47250-c25c-45c2-8c66-0ad7a8c8ef99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:48.493788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-eca47250-c25c-45c2-8c66-0ad7a8c8ef99 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1722 microversion: 2.20 time: 0.325294 Oct 06 12:34:48.494436 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 564/1131] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:34:48 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:34:49.395302 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-67a89905-017f-4f2e-a19d-846f3376c1c9 req-fb7c830f-24e6-429c-ae46-ffdc093510bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c743b80a-43e9-4dc1-a570-6873a5992f34", "name": "network-vif-deleted", "tag": "fc7be519-3630-4616-ad76-14402cf4ad87"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:34:49.405964 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-67a89905-017f-4f2e-a19d-846f3376c1c9 req-fb7c830f-24e6-429c-ae46-ffdc093510bd service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:49.406452 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-67a89905-017f-4f2e-a19d-846f3376c1c9 req-fb7c830f-24e6-429c-ae46-ffdc093510bd service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:49.406892 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-67a89905-017f-4f2e-a19d-846f3376c1c9 req-fb7c830f-24e6-429c-ae46-ffdc093510bd service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:49.425327 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-67a89905-017f-4f2e-a19d-846f3376c1c9 req-fb7c830f-24e6-429c-ae46-ffdc093510bd service nova] Creating event network-vif-deleted:fc7be519-3630-4616-ad76-14402cf4ad87 for instance c743b80a-43e9-4dc1-a570-6873a5992f34 on hv-cinder-85604 Oct 06 12:34:49.431043 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-67a89905-017f-4f2e-a19d-846f3376c1c9 req-fb7c830f-24e6-429c-ae46-ffdc093510bd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039442 Oct 06 12:34:49.431808 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d2154677-433b-4cd3-b38d-81cb914ebd48 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:49.432520 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d2154677-433b-4cd3-b38d-81cb914ebd48 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:49.435272 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 568/1132] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:34:49.440164 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d2154677-433b-4cd3-b38d-81cb914ebd48 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:49.440733 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d2154677-433b-4cd3-b38d-81cb914ebd48 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:49.441105 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d2154677-433b-4cd3-b38d-81cb914ebd48 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:49.442058 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d2154677-433b-4cd3-b38d-81cb914ebd48 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:49.442573 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d2154677-433b-4cd3-b38d-81cb914ebd48 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:49.443023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d2154677-433b-4cd3-b38d-81cb914ebd48 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:49.519356 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:49.520359 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:49.528241 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:49.529211 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:49.529840 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:49.530824 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:49.531291 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:49.531816 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:49.575623 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:49.576432 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:49.577177 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:49.577640 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lazy-loading 'fault' on Instance uuid c743b80a-43e9-4dc1-a570-6873a5992f34 {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:34:49.636531 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:49.646567 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:49.648340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9c115c7083441c8b363e9b685ef110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6037b1d4b4d31b7a7ad298452cfbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:49.649754 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c2357d74-b805-4f70-84db-42ce111f4860 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 200 len: 1372 microversion: 2.20 time: 0.135002 Oct 06 12:34:49.657486 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 569/1133] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:34:49 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 1372 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:34:49.694038 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d2154677-433b-4cd3-b38d-81cb914ebd48 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:49.702467 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d2154677-433b-4cd3-b38d-81cb914ebd48 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 200 len: 1368 microversion: 2.1 time: 0.277303 Oct 06 12:34:49.703274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 565/1134] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:34:49 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:34:50.211932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-48f4ce31-dfa8-458c-8666-244f5a104900 req-94052ec3-b37e-4e55-b68a-6bb4ac6dfb76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aae47f4-74e0-47ee-8859-407ff1e7a221", "name": "network-vif-plugged", "status": "completed", "tag": "df8efaa3-7d04-48a0-a529-0bdb59ee2149"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:34:50.224064 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-48f4ce31-dfa8-458c-8666-244f5a104900 req-94052ec3-b37e-4e55-b68a-6bb4ac6dfb76 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:50.224545 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-48f4ce31-dfa8-458c-8666-244f5a104900 req-94052ec3-b37e-4e55-b68a-6bb4ac6dfb76 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:50.224973 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-48f4ce31-dfa8-458c-8666-244f5a104900 req-94052ec3-b37e-4e55-b68a-6bb4ac6dfb76 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:50.237007 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-48f4ce31-dfa8-458c-8666-244f5a104900 req-94052ec3-b37e-4e55-b68a-6bb4ac6dfb76 service nova] Creating event network-vif-plugged:df8efaa3-7d04-48a0-a529-0bdb59ee2149 for instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 on hv-cinder-85604 Oct 06 12:34:50.242250 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-48f4ce31-dfa8-458c-8666-244f5a104900 req-94052ec3-b37e-4e55-b68a-6bb4ac6dfb76 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033810 Oct 06 12:34:50.243776 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 570/1135] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:34:50.678313 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3577c79c-9bb7-42af-827a-afa3dd9acfe3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:50.678845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3577c79c-9bb7-42af-827a-afa3dd9acfe3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:50.685845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3577c79c-9bb7-42af-827a-afa3dd9acfe3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:50.686323 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3577c79c-9bb7-42af-827a-afa3dd9acfe3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:50.686757 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3577c79c-9bb7-42af-827a-afa3dd9acfe3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:50.687444 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3577c79c-9bb7-42af-827a-afa3dd9acfe3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:50.687925 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3577c79c-9bb7-42af-827a-afa3dd9acfe3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:50.688348 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3577c79c-9bb7-42af-827a-afa3dd9acfe3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:50.701414 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-3577c79c-9bb7-42af-827a-afa3dd9acfe3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] HTTP exception thrown: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3577c79c-9bb7-42af-827a-afa3dd9acfe3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Request method failure captured: Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 HTTP/1.1 Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPskLXklXJxJhd0r3JClsVo5dxP9xpmS5-fbjtVmLmy39IiXED91itGt-EYMmpuxi2-uT5T6P-lohvFutACE9-utPn8JBxpwTIZaM7yMfWAA5ADmlQW_L5OpO2aYURTra2iSTX2gH-OB8CM3tdMdaqa3LPANX289Cjjocl-DOK4drdaI Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: eda6037b1d4b4d31b7a7ad298452cfbb Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:34:50.703069 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:34:50.704929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eda6037b1d4b4d31b7a7ad298452cfbb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:34:50.704929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:34:50.704929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: eda6037b1d4b4d31b7a7ad298452cfbb Oct 06 12:34:50.704929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:34:50.704929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-AttachVolumeShelveTestJSON-1479776453-project Oct 06 12:34:50.704929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:34:50.704929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:34:50.704929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: ff9c115c7083441c8b363e9b685ef110 Oct 06 12:34:50.704929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1479776453-project Oct 06 12:34:50.704929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:34:50.704929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. Oct 06 12:34:50.704929 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': 'c743b80a-43e9-4dc1-a570-6873a5992f34'} Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:34:50.705895 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. Oct 06 12:34:50.707565 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:34:50.709250 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3577c79c-9bb7-42af-827a-afa3dd9acfe3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Returning 404 to user: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:34:50.709250 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3577c79c-9bb7-42af-827a-afa3dd9acfe3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 404 len: 111 microversion: 2.20 time: 0.030156 Oct 06 12:34:50.709250 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 566/1136] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:34:50 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:34:50.714509 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d799941c-9fe7-4581-8072-5773552ba6f3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '.version_select at 0x7f03aac5b700>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:50.725799 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2d946dcf-a19b-4d2f-84e0-64634bbf8057 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:50.726407 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2d946dcf-a19b-4d2f-84e0-64634bbf8057 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:50.732870 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2d946dcf-a19b-4d2f-84e0-64634bbf8057 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:50.733435 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2d946dcf-a19b-4d2f-84e0-64634bbf8057 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:50.733616 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d799941c-9fe7-4581-8072-5773552ba6f3 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534206062" status: 204 len: 0 microversion: 2.20 time: 0.023621 Oct 06 12:34:50.733883 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2d946dcf-a19b-4d2f-84e0-64634bbf8057 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:50.734297 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 571/1137] 10.222.0.33 () {60 vars in 1262 bytes} [Thu Oct 6 12:34:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534206062 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:34:50.734644 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2d946dcf-a19b-4d2f-84e0-64634bbf8057 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:50.735305 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2d946dcf-a19b-4d2f-84e0-64634bbf8057 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:50.735634 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2d946dcf-a19b-4d2f-84e0-64634bbf8057 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:50.925342 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2d946dcf-a19b-4d2f-84e0-64634bbf8057 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:50.932881 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2d946dcf-a19b-4d2f-84e0-64634bbf8057 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 200 len: 1368 microversion: 2.1 time: 0.210804 Oct 06 12:34:50.933384 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 567/1138] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:34:50 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:34:51.953745 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=6 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:34:51.958171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-427bd00e-4588-4408-b5dc-c281798571cd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:51.958873 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-427bd00e-4588-4408-b5dc-c281798571cd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:51.967630 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-427bd00e-4588-4408-b5dc-c281798571cd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:51.968110 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-427bd00e-4588-4408-b5dc-c281798571cd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:51.968543 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-427bd00e-4588-4408-b5dc-c281798571cd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:51.969226 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-427bd00e-4588-4408-b5dc-c281798571cd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:51.969675 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-427bd00e-4588-4408-b5dc-c281798571cd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:51.970095 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-427bd00e-4588-4408-b5dc-c281798571cd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:52.099866 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-427bd00e-4588-4408-b5dc-c281798571cd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:52.108310 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-427bd00e-4588-4408-b5dc-c281798571cd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 200 len: 1368 microversion: 2.1 time: 0.155431 Oct 06 12:34:52.108879 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 572/1139] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:34:51 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:34:52.562245 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-da74d364-6740-453b-97aa-dbf8d7ebd26d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:52.563122 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-da74d364-6740-453b-97aa-dbf8d7ebd26d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:52.566359 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:34:52.567432 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=6 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:34:52.577821 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da74d364-6740-453b-97aa-dbf8d7ebd26d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:52.578479 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da74d364-6740-453b-97aa-dbf8d7ebd26d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:52.579005 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da74d364-6740-453b-97aa-dbf8d7ebd26d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:52.580039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da74d364-6740-453b-97aa-dbf8d7ebd26d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:52.580574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da74d364-6740-453b-97aa-dbf8d7ebd26d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:52.581077 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da74d364-6740-453b-97aa-dbf8d7ebd26d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:52.595617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-da74d364-6740-453b-97aa-dbf8d7ebd26d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] HTTP exception thrown: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-da74d364-6740-453b-97aa-dbf8d7ebd26d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Request method failure captured: Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: DELETE /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 HTTP/1.1 Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPskLXklXJxJhd0r3JClsVo5dxP9xpmS5-fbjtVmLmy39IiXED91itGt-EYMmpuxi2-uT5T6P-lohvFutACE9-utPn8JBxpwTIZaM7yMfWAA5ADmlQW_L5OpO2aYURTra2iSTX2gH-OB8CM3tdMdaqa3LPANX289Cjjocl-DOK4drdaI Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: eda6037b1d4b4d31b7a7ad298452cfbb Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:34:52.597286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:34:52.599052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eda6037b1d4b4d31b7a7ad298452cfbb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:34:52.599052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:34:52.599052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: eda6037b1d4b4d31b7a7ad298452cfbb Oct 06 12:34:52.599052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:34:52.599052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-AttachVolumeShelveTestJSON-1479776453-project Oct 06 12:34:52.599052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:34:52.599052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:34:52.599052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: ff9c115c7083441c8b363e9b685ef110 Oct 06 12:34:52.599052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1479776453-project Oct 06 12:34:52.599052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:34:52.599052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. Oct 06 12:34:52.599052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': 'c743b80a-43e9-4dc1-a570-6873a5992f34'} Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:34:52.600039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. Oct 06 12:34:52.601542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:34:52.603171 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-da74d364-6740-453b-97aa-dbf8d7ebd26d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Returning 404 to user: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:34:52.603171 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-da74d364-6740-453b-97aa-dbf8d7ebd26d tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 404 len: 111 microversion: 2.20 time: 0.043919 Oct 06 12:34:52.603171 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 568/1140] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Oct 6 12:34:52 2022] DELETE /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:34:52.607967 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6719099c-6fb2-41de-8351-25ac53e5ad1c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:52.608570 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-6719099c-6fb2-41de-8351-25ac53e5ad1c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: c743b80a-43e9-4dc1-a570-6873a5992f34] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:52.614356 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6719099c-6fb2-41de-8351-25ac53e5ad1c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:52.614833 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6719099c-6fb2-41de-8351-25ac53e5ad1c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:52.615262 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6719099c-6fb2-41de-8351-25ac53e5ad1c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:52.615977 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6719099c-6fb2-41de-8351-25ac53e5ad1c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:52.616426 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6719099c-6fb2-41de-8351-25ac53e5ad1c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:52.616841 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-6719099c-6fb2-41de-8351-25ac53e5ad1c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:52.629767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-6719099c-6fb2-41de-8351-25ac53e5ad1c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] HTTP exception thrown: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6719099c-6fb2-41de-8351-25ac53e5ad1c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Request method failure captured: Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 HTTP/1.1 Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPskLXklXJxJhd0r3JClsVo5dxP9xpmS5-fbjtVmLmy39IiXED91itGt-EYMmpuxi2-uT5T6P-lohvFutACE9-utPn8JBxpwTIZaM7yMfWAA5ADmlQW_L5OpO2aYURTra2iSTX2gH-OB8CM3tdMdaqa3LPANX289Cjjocl-DOK4drdaI Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: eda6037b1d4b4d31b7a7ad298452cfbb Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:34:52.631420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:34:52.633109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eda6037b1d4b4d31b7a7ad298452cfbb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:34:52.633109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:34:52.633109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: eda6037b1d4b4d31b7a7ad298452cfbb Oct 06 12:34:52.633109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:34:52.633109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-AttachVolumeShelveTestJSON-1479776453-project Oct 06 12:34:52.633109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:34:52.633109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:34:52.633109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: ff9c115c7083441c8b363e9b685ef110 Oct 06 12:34:52.633109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1479776453-project Oct 06 12:34:52.633109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:34:52.633109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. Oct 06 12:34:52.633109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': 'c743b80a-43e9-4dc1-a570-6873a5992f34'} Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:34:52.634044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. Oct 06 12:34:52.635585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:34:52.637157 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-6719099c-6fb2-41de-8351-25ac53e5ad1c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Returning 404 to user: Instance c743b80a-43e9-4dc1-a570-6873a5992f34 could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:34:52.637157 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-6719099c-6fb2-41de-8351-25ac53e5ad1c tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34" status: 404 len: 111 microversion: 2.20 time: 0.029438 Oct 06 12:34:52.637157 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 573/1141] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:34:52 2022] GET /compute/v2.1/servers/c743b80a-43e9-4dc1-a570-6873a5992f34 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:34:53.132138 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-64904dc9-dfc4-4135-8e3a-fd20f4edf253 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:53.132738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-64904dc9-dfc4-4135-8e3a-fd20f4edf253 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:53.139294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64904dc9-dfc4-4135-8e3a-fd20f4edf253 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:53.139859 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64904dc9-dfc4-4135-8e3a-fd20f4edf253 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:53.140289 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64904dc9-dfc4-4135-8e3a-fd20f4edf253 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:53.141032 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64904dc9-dfc4-4135-8e3a-fd20f4edf253 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:53.141481 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64904dc9-dfc4-4135-8e3a-fd20f4edf253 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:53.142027 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-64904dc9-dfc4-4135-8e3a-fd20f4edf253 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:53.272151 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-64904dc9-dfc4-4135-8e3a-fd20f4edf253 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:34:53.280528 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-64904dc9-dfc4-4135-8e3a-fd20f4edf253 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 200 len: 1558 microversion: 2.1 time: 0.152173 Oct 06 12:34:53.281095 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 569/1142] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:34:53 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:34:53.303024 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-22410351-2156-477f-b9c5-d57fa89270e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:53.303562 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-22410351-2156-477f-b9c5-d57fa89270e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:53.309815 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22410351-2156-477f-b9c5-d57fa89270e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:53.310294 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22410351-2156-477f-b9c5-d57fa89270e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:53.310725 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22410351-2156-477f-b9c5-d57fa89270e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:53.311407 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22410351-2156-477f-b9c5-d57fa89270e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:53.311882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22410351-2156-477f-b9c5-d57fa89270e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:53.312303 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-22410351-2156-477f-b9c5-d57fa89270e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:53.387437 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-22410351-2156-477f-b9c5-d57fa89270e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088226 Oct 06 12:34:53.388067 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 574/1143] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 12:34:53 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:34:53.781330 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-853bc940-10c6-4f17-acbe-bcb761d969d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:53.781834 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-853bc940-10c6-4f17-acbe-bcb761d969d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:53.788891 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-853bc940-10c6-4f17-acbe-bcb761d969d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:53.789363 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-853bc940-10c6-4f17-acbe-bcb761d969d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:53.789806 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-853bc940-10c6-4f17-acbe-bcb761d969d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:53.790575 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-853bc940-10c6-4f17-acbe-bcb761d969d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:53.791236 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-853bc940-10c6-4f17-acbe-bcb761d969d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:53.791696 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-853bc940-10c6-4f17-acbe-bcb761d969d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:53.805196 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-853bc940-10c6-4f17-acbe-bcb761d969d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] HTTP exception thrown: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-853bc940-10c6-4f17-acbe-bcb761d969d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Request method failure captured: Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: DELETE /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 HTTP/1.1 Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPskLXklXJxJhd0r3JClsVo5dxP9xpmS5-fbjtVmLmy39IiXED91itGt-EYMmpuxi2-uT5T6P-lohvFutACE9-utPn8JBxpwTIZaM7yMfWAA5ADmlQW_L5OpO2aYURTra2iSTX2gH-OB8CM3tdMdaqa3LPANX289Cjjocl-DOK4drdaI Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: eda6037b1d4b4d31b7a7ad298452cfbb Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:34:53.806781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:34:53.809117 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eda6037b1d4b4d31b7a7ad298452cfbb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:34:53.809117 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:34:53.809117 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: eda6037b1d4b4d31b7a7ad298452cfbb Oct 06 12:34:53.809117 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:34:53.809117 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-AttachVolumeShelveTestJSON-1479776453-project Oct 06 12:34:53.809117 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:34:53.809117 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:34:53.809117 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: ff9c115c7083441c8b363e9b685ef110 Oct 06 12:34:53.809117 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1479776453-project Oct 06 12:34:53.809117 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:34:53.809117 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. Oct 06 12:34:53.809117 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '5b1825b8-e10c-4c5b-adf9-3456c97a68e2'} Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:34:53.810107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. Oct 06 12:34:53.811760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:34:53.813329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-853bc940-10c6-4f17-acbe-bcb761d969d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Returning 404 to user: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:34:53.813329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-853bc940-10c6-4f17-acbe-bcb761d969d7 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 404 len: 111 microversion: 2.20 time: 0.031609 Oct 06 12:34:53.813329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 570/1144] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Oct 6 12:34:53 2022] DELETE /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:34:53.817366 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-97f8f391-73e9-45f7-be53-65f0ac67a984 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:34:53.817967 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-97f8f391-73e9-45f7-be53-65f0ac67a984 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] [instance: 5b1825b8-e10c-4c5b-adf9-3456c97a68e2] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:34:53.824088 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-97f8f391-73e9-45f7-be53-65f0ac67a984 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:53.825203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-97f8f391-73e9-45f7-be53-65f0ac67a984 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:53.825634 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-97f8f391-73e9-45f7-be53-65f0ac67a984 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:53.826325 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-97f8f391-73e9-45f7-be53-65f0ac67a984 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:53.826772 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-97f8f391-73e9-45f7-be53-65f0ac67a984 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:53.827192 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-97f8f391-73e9-45f7-be53-65f0ac67a984 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:53.840446 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-97f8f391-73e9-45f7-be53-65f0ac67a984 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] HTTP exception thrown: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-97f8f391-73e9-45f7-be53-65f0ac67a984 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Request method failure captured: Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 HTTP/1.1 Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPskLXklXJxJhd0r3JClsVo5dxP9xpmS5-fbjtVmLmy39IiXED91itGt-EYMmpuxi2-uT5T6P-lohvFutACE9-utPn8JBxpwTIZaM7yMfWAA5ADmlQW_L5OpO2aYURTra2iSTX2gH-OB8CM3tdMdaqa3LPANX289Cjjocl-DOK4drdaI Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: eda6037b1d4b4d31b7a7ad298452cfbb Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:34:53.841970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:34:53.843762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eda6037b1d4b4d31b7a7ad298452cfbb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eda6037b1d4b4d31b7a7ad298452cfbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:34:53.843762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:34:53.843762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: eda6037b1d4b4d31b7a7ad298452cfbb Oct 06 12:34:53.843762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1479776453 Oct 06 12:34:53.843762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-AttachVolumeShelveTestJSON-1479776453-project Oct 06 12:34:53.843762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:34:53.843762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:34:53.843762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: ff9c115c7083441c8b363e9b685ef110 Oct 06 12:34:53.843762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1479776453-project Oct 06 12:34:53.843762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:34:53.843762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. Oct 06 12:34:53.843762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '5b1825b8-e10c-4c5b-adf9-3456c97a68e2'} Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:34:53.844664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. Oct 06 12:34:53.846232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:34:53.847701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-97f8f391-73e9-45f7-be53-65f0ac67a984 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] Returning 404 to user: Instance 5b1825b8-e10c-4c5b-adf9-3456c97a68e2 could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:34:53.847701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-97f8f391-73e9-45f7-be53-65f0ac67a984 tempest-AttachVolumeShelveTestJSON-1479776453 tempest-AttachVolumeShelveTestJSON-1479776453-project] 10.222.0.33 "GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2" status: 404 len: 111 microversion: 2.20 time: 0.029837 Oct 06 12:34:53.847701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 575/1145] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 12:34:53 2022] GET /compute/v2.1/servers/5b1825b8-e10c-4c5b-adf9-3456c97a68e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:34:54.319324 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-e1b62e3c-c2b6-42ee-80a4-ed4778140ed5 req-1fe4a656-bc9c-4c49-b624-d47e8d47e3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aae47f4-74e0-47ee-8859-407ff1e7a221", "tag": "df8efaa3-7d04-48a0-a529-0bdb59ee2149"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:34:54.328845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-e1b62e3c-c2b6-42ee-80a4-ed4778140ed5 req-1fe4a656-bc9c-4c49-b624-d47e8d47e3c8 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:34:54.329409 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-e1b62e3c-c2b6-42ee-80a4-ed4778140ed5 req-1fe4a656-bc9c-4c49-b624-d47e8d47e3c8 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:34:54.329911 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-e1b62e3c-c2b6-42ee-80a4-ed4778140ed5 req-1fe4a656-bc9c-4c49-b624-d47e8d47e3c8 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:34:54.345522 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-e1b62e3c-c2b6-42ee-80a4-ed4778140ed5 req-1fe4a656-bc9c-4c49-b624-d47e8d47e3c8 service nova] Creating event network-changed:df8efaa3-7d04-48a0-a529-0bdb59ee2149 for instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 on hv-cinder-85604 Oct 06 12:34:54.352180 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-e1b62e3c-c2b6-42ee-80a4-ed4778140ed5 req-1fe4a656-bc9c-4c49-b624-d47e8d47e3c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036346 Oct 06 12:34:54.352803 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 571/1146] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:35:40.074894 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c6672bab-eb62-4c25-b71c-3a25e9697196 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:40.075988 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c6672bab-eb62-4c25-b71c-3a25e9697196 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:40.078646 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:35:40.079450 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:35:40.080274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:35:40.082454 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=62 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:35:40.090773 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6672bab-eb62-4c25-b71c-3a25e9697196 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:40.091882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6672bab-eb62-4c25-b71c-3a25e9697196 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:40.093118 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6672bab-eb62-4c25-b71c-3a25e9697196 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:40.094280 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6672bab-eb62-4c25-b71c-3a25e9697196 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:40.094975 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6672bab-eb62-4c25-b71c-3a25e9697196 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:40.095746 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6672bab-eb62-4c25-b71c-3a25e9697196 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:40.129413 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c6672bab-eb62-4c25-b71c-3a25e9697196 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Going to try to terminate instance {{(pid=120508) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:35:40.249612 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c6672bab-eb62-4c25-b71c-3a25e9697196 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "DELETE /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 204 len: 0 microversion: 2.1 time: 0.175192 Oct 06 12:35:40.250654 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 576/1147] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:35:40 2022] DELETE /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:35:40.252557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-8c41cae8-ea19-4fa9-9f17-a008247cbad7 req-0fb567c7-0d1b-4f40-a5ee-e4f1973e5fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "621f2a35-3a2e-4b6f-af2b-67399b85d360", "tag": "09838f9f-3bca-496d-a61f-cacc2bc37a5d"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:35:40.262339 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-dbe2e77d-5951-437b-9241-b3f72ed6c785 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:40.263131 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-dbe2e77d-5951-437b-9241-b3f72ed6c785 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:40.269500 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dbe2e77d-5951-437b-9241-b3f72ed6c785 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:40.270075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dbe2e77d-5951-437b-9241-b3f72ed6c785 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:40.270593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dbe2e77d-5951-437b-9241-b3f72ed6c785 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:40.271372 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dbe2e77d-5951-437b-9241-b3f72ed6c785 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:40.272066 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dbe2e77d-5951-437b-9241-b3f72ed6c785 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:40.272333 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-8c41cae8-ea19-4fa9-9f17-a008247cbad7 req-0fb567c7-0d1b-4f40-a5ee-e4f1973e5fb7 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:40.272638 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dbe2e77d-5951-437b-9241-b3f72ed6c785 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:40.273291 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-8c41cae8-ea19-4fa9-9f17-a008247cbad7 req-0fb567c7-0d1b-4f40-a5ee-e4f1973e5fb7 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:40.273984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-8c41cae8-ea19-4fa9-9f17-a008247cbad7 req-0fb567c7-0d1b-4f40-a5ee-e4f1973e5fb7 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:40.287054 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-8c41cae8-ea19-4fa9-9f17-a008247cbad7 req-0fb567c7-0d1b-4f40-a5ee-e4f1973e5fb7 service nova] Creating event network-changed:09838f9f-3bca-496d-a61f-cacc2bc37a5d for instance 621f2a35-3a2e-4b6f-af2b-67399b85d360 on hv-cinder-85604 Oct 06 12:35:40.298113 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-8c41cae8-ea19-4fa9-9f17-a008247cbad7 req-0fb567c7-0d1b-4f40-a5ee-e4f1973e5fb7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231930 Oct 06 12:35:40.303881 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 572/1148] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:35:40.422285 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-dbe2e77d-5951-437b-9241-b3f72ed6c785 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:35:40.430403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-dbe2e77d-5951-437b-9241-b3f72ed6c785 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1576 microversion: 2.1 time: 0.172338 Oct 06 12:35:40.431676 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 577/1149] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:35:40 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:35:41.457337 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-23de6d7a-db2d-4d19-aa63-2563df0d9e66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:41.457948 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-23de6d7a-db2d-4d19-aa63-2563df0d9e66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:41.463955 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23de6d7a-db2d-4d19-aa63-2563df0d9e66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:41.464418 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23de6d7a-db2d-4d19-aa63-2563df0d9e66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:41.464845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23de6d7a-db2d-4d19-aa63-2563df0d9e66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:41.465517 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23de6d7a-db2d-4d19-aa63-2563df0d9e66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:41.465965 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23de6d7a-db2d-4d19-aa63-2563df0d9e66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:41.466382 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-23de6d7a-db2d-4d19-aa63-2563df0d9e66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:41.603806 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-23de6d7a-db2d-4d19-aa63-2563df0d9e66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:35:41.611469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-23de6d7a-db2d-4d19-aa63-2563df0d9e66 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1576 microversion: 2.1 time: 0.158982 Oct 06 12:35:41.612063 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 573/1150] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:35:41 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:35:42.634187 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-eeae3805-bcb7-4da1-acb7-edb1c1400950 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:42.634932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-eeae3805-bcb7-4da1-acb7-edb1c1400950 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:42.642198 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eeae3805-bcb7-4da1-acb7-edb1c1400950 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:42.642692 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eeae3805-bcb7-4da1-acb7-edb1c1400950 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:42.643132 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eeae3805-bcb7-4da1-acb7-edb1c1400950 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:42.643864 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eeae3805-bcb7-4da1-acb7-edb1c1400950 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:42.644328 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eeae3805-bcb7-4da1-acb7-edb1c1400950 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:42.644767 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-eeae3805-bcb7-4da1-acb7-edb1c1400950 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:43.104176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-eeae3805-bcb7-4da1-acb7-edb1c1400950 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:35:43.112177 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-eeae3805-bcb7-4da1-acb7-edb1c1400950 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1458 microversion: 2.1 time: 0.481836 Oct 06 12:35:43.112755 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 578/1151] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:35:42 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1458 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:35:43.493006 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-134f0522-d009-4ef4-b884-9f07980492f2 req-24153f2c-dc14-454c-8074-635ebf2797f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621f2a35-3a2e-4b6f-af2b-67399b85d360", "name": "network-vif-deleted", "tag": "09838f9f-3bca-496d-a61f-cacc2bc37a5d"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:35:43.502720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-134f0522-d009-4ef4-b884-9f07980492f2 req-24153f2c-dc14-454c-8074-635ebf2797f6 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:43.503140 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-134f0522-d009-4ef4-b884-9f07980492f2 req-24153f2c-dc14-454c-8074-635ebf2797f6 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:43.503593 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-134f0522-d009-4ef4-b884-9f07980492f2 req-24153f2c-dc14-454c-8074-635ebf2797f6 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:43.516287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-134f0522-d009-4ef4-b884-9f07980492f2 req-24153f2c-dc14-454c-8074-635ebf2797f6 service nova] Creating event network-vif-deleted:09838f9f-3bca-496d-a61f-cacc2bc37a5d for instance 621f2a35-3a2e-4b6f-af2b-67399b85d360 on hv-cinder-85604 Oct 06 12:35:43.521222 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-134f0522-d009-4ef4-b884-9f07980492f2 req-24153f2c-dc14-454c-8074-635ebf2797f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144028 Oct 06 12:35:43.521792 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 574/1152] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:35:44.135026 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-42b43fda-81af-4eeb-a628-c28aa97b9d5f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:44.135659 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-42b43fda-81af-4eeb-a628-c28aa97b9d5f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:44.142000 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-42b43fda-81af-4eeb-a628-c28aa97b9d5f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:44.142478 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-42b43fda-81af-4eeb-a628-c28aa97b9d5f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:44.142907 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-42b43fda-81af-4eeb-a628-c28aa97b9d5f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:44.143615 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-42b43fda-81af-4eeb-a628-c28aa97b9d5f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:44.144069 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-42b43fda-81af-4eeb-a628-c28aa97b9d5f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:44.144486 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-42b43fda-81af-4eeb-a628-c28aa97b9d5f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:44.207093 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-42b43fda-81af-4eeb-a628-c28aa97b9d5f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:35:44.214688 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-42b43fda-81af-4eeb-a628-c28aa97b9d5f tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1390 microversion: 2.1 time: 0.083537 Oct 06 12:35:44.215249 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 579/1153] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:35:44 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:35:45.239137 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2c0a3cdb-d045-4bf6-b3e7-e3995acc147a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:45.239869 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2c0a3cdb-d045-4bf6-b3e7-e3995acc147a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:45.246154 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c0a3cdb-d045-4bf6-b3e7-e3995acc147a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:45.246634 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c0a3cdb-d045-4bf6-b3e7-e3995acc147a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:45.247062 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c0a3cdb-d045-4bf6-b3e7-e3995acc147a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:45.247778 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c0a3cdb-d045-4bf6-b3e7-e3995acc147a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:45.248429 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c0a3cdb-d045-4bf6-b3e7-e3995acc147a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:45.248858 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2c0a3cdb-d045-4bf6-b3e7-e3995acc147a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:45.310023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2c0a3cdb-d045-4bf6-b3e7-e3995acc147a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:35:45.317639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2c0a3cdb-d045-4bf6-b3e7-e3995acc147a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1225 microversion: 2.1 time: 0.083210 Oct 06 12:35:45.318196 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 575/1154] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:35:45 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:35:46.340924 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-80969718-56d3-45b2-8f70-243d869a2f32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:46.341535 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-80969718-56d3-45b2-8f70-243d869a2f32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:46.347569 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-80969718-56d3-45b2-8f70-243d869a2f32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:46.348053 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-80969718-56d3-45b2-8f70-243d869a2f32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:46.348487 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-80969718-56d3-45b2-8f70-243d869a2f32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:46.349180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-80969718-56d3-45b2-8f70-243d869a2f32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:46.349638 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-80969718-56d3-45b2-8f70-243d869a2f32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:46.350063 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-80969718-56d3-45b2-8f70-243d869a2f32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:46.412413 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-80969718-56d3-45b2-8f70-243d869a2f32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:35:46.420085 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-80969718-56d3-45b2-8f70-243d869a2f32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1225 microversion: 2.1 time: 0.083073 Oct 06 12:35:46.420672 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 580/1155] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:35:46 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:35:47.442826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-cb356c77-cda7-4482-af79-c5a9961dd6e8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:47.443394 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-cb356c77-cda7-4482-af79-c5a9961dd6e8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:47.449670 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cb356c77-cda7-4482-af79-c5a9961dd6e8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:47.450152 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cb356c77-cda7-4482-af79-c5a9961dd6e8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:47.450570 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cb356c77-cda7-4482-af79-c5a9961dd6e8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:47.451247 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cb356c77-cda7-4482-af79-c5a9961dd6e8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:47.452294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cb356c77-cda7-4482-af79-c5a9961dd6e8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:47.452716 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cb356c77-cda7-4482-af79-c5a9961dd6e8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:47.512667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-cb356c77-cda7-4482-af79-c5a9961dd6e8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:35:47.520940 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-cb356c77-cda7-4482-af79-c5a9961dd6e8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1225 microversion: 2.1 time: 0.082055 Oct 06 12:35:47.521497 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 576/1156] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:35:47 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:35:48.544947 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-072e327f-f2cd-4aad-aa0c-bdde2c2bcd32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:48.546100 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-072e327f-f2cd-4aad-aa0c-bdde2c2bcd32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:48.552958 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-072e327f-f2cd-4aad-aa0c-bdde2c2bcd32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:48.553456 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-072e327f-f2cd-4aad-aa0c-bdde2c2bcd32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:48.553886 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-072e327f-f2cd-4aad-aa0c-bdde2c2bcd32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:48.554579 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-072e327f-f2cd-4aad-aa0c-bdde2c2bcd32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:48.555031 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-072e327f-f2cd-4aad-aa0c-bdde2c2bcd32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:48.555451 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-072e327f-f2cd-4aad-aa0c-bdde2c2bcd32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:48.587332 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-072e327f-f2cd-4aad-aa0c-bdde2c2bcd32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:48.587845 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-072e327f-f2cd-4aad-aa0c-bdde2c2bcd32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:48.588283 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-072e327f-f2cd-4aad-aa0c-bdde2c2bcd32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:48.588725 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-072e327f-f2cd-4aad-aa0c-bdde2c2bcd32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lazy-loading 'fault' on Instance uuid 621f2a35-3a2e-4b6f-af2b-67399b85d360 {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:35:48.633641 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-072e327f-f2cd-4aad-aa0c-bdde2c2bcd32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:35:48.648518 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-072e327f-f2cd-4aad-aa0c-bdde2c2bcd32 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 200 len: 1230 microversion: 2.1 time: 0.105640 Oct 06 12:35:48.649246 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 581/1157] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:35:48 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:35:49.673622 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4555ea5b-4cce-45b3-84d6-9bb3df808fd8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:49.674232 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4555ea5b-4cce-45b3-84d6-9bb3df808fd8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 621f2a35-3a2e-4b6f-af2b-67399b85d360] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:49.680576 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4555ea5b-4cce-45b3-84d6-9bb3df808fd8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:49.681053 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4555ea5b-4cce-45b3-84d6-9bb3df808fd8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:49.681482 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4555ea5b-4cce-45b3-84d6-9bb3df808fd8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:49.682158 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4555ea5b-4cce-45b3-84d6-9bb3df808fd8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:49.682600 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4555ea5b-4cce-45b3-84d6-9bb3df808fd8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:49.683017 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4555ea5b-4cce-45b3-84d6-9bb3df808fd8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:49.696595 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-4555ea5b-4cce-45b3-84d6-9bb3df808fd8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] HTTP exception thrown: Instance 621f2a35-3a2e-4b6f-af2b-67399b85d360 could not be found. Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4555ea5b-4cce-45b3-84d6-9bb3df808fd8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Request method failure captured: Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 HTTP/1.1 Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPskuUx-wlgzCT7jVFY503HfgQZALsqMNcThj2AfG-b4jN2uZrnSDMB5RSgbFAUp_HzkY7gHKqtaUnqa5tZZ1ZQpDsbGSqYb1r2ZhZEZesbhgTxU5q2cWAmN80R4s-VeljjIEKovSZW9w-Plwe1BypUYEi5WPWLytPj8bKma4RUaIMwY Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: c80feb95ecbf413ca0bc52a519bf43b7 Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-TestVolumeBootPattern-152508398 Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:35:49.698178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:35:49.699896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c80feb95ecbf413ca0bc52a519bf43b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c80feb95ecbf413ca0bc52a519bf43b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c80feb95ecbf413ca0bc52a519bf43b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c80feb95ecbf413ca0bc52a519bf43b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:35:49.699896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-TestVolumeBootPattern-152508398 Oct 06 12:35:49.699896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: c80feb95ecbf413ca0bc52a519bf43b7 Oct 06 12:35:49.699896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-TestVolumeBootPattern-152508398 Oct 06 12:35:49.699896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-TestVolumeBootPattern-152508398-project Oct 06 12:35:49.699896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:35:49.699896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:35:49.699896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: dff0daad12c143fabd16d40a1939b87e Oct 06 12:35:49.699896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-TestVolumeBootPattern-152508398-project Oct 06 12:35:49.699896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:35:49.699896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 621f2a35-3a2e-4b6f-af2b-67399b85d360 could not be found. Oct 06 12:35:49.699896 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '621f2a35-3a2e-4b6f-af2b-67399b85d360'} Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 621f2a35-3a2e-4b6f-af2b-67399b85d360 could not be found. Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:35:49.700861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 621f2a35-3a2e-4b6f-af2b-67399b85d360 could not be found. Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 621f2a35-3a2e-4b6f-af2b-67399b85d360 could not be found. Oct 06 12:35:49.703070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:35:49.704615 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4555ea5b-4cce-45b3-84d6-9bb3df808fd8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Returning 404 to user: Instance 621f2a35-3a2e-4b6f-af2b-67399b85d360 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:35:49.704615 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4555ea5b-4cce-45b3-84d6-9bb3df808fd8 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360" status: 404 len: 111 microversion: 2.1 time: 0.029811 Oct 06 12:35:49.704615 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 577/1158] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:35:49 2022] GET /compute/v2.1/servers/621f2a35-3a2e-4b6f-af2b-67399b85d360 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:35:52.785674 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f4a33abc-46ee-41f9-8085-39ebbce5656a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:52.786789 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f4a33abc-46ee-41f9-8085-39ebbce5656a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:52.789410 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-378bb4c1-0c0a-4910-a919-b20bf2d77e8f req-00d750d1-5998-4097-bc30-e00ee8a49b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094", "tag": "80e7b3d0-e904-4d2f-8247-bd9a538f244c"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:35:52.795723 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4a33abc-46ee-41f9-8085-39ebbce5656a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:52.796558 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4a33abc-46ee-41f9-8085-39ebbce5656a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:52.797224 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4a33abc-46ee-41f9-8085-39ebbce5656a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:52.798254 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4a33abc-46ee-41f9-8085-39ebbce5656a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:52.798908 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4a33abc-46ee-41f9-8085-39ebbce5656a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:52.799619 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f4a33abc-46ee-41f9-8085-39ebbce5656a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:52.803548 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-378bb4c1-0c0a-4910-a919-b20bf2d77e8f req-00d750d1-5998-4097-bc30-e00ee8a49b07 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:52.805126 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-378bb4c1-0c0a-4910-a919-b20bf2d77e8f req-00d750d1-5998-4097-bc30-e00ee8a49b07 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:52.805561 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-378bb4c1-0c0a-4910-a919-b20bf2d77e8f req-00d750d1-5998-4097-bc30-e00ee8a49b07 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:52.821532 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-378bb4c1-0c0a-4910-a919-b20bf2d77e8f req-00d750d1-5998-4097-bc30-e00ee8a49b07 service nova] Creating event network-changed:80e7b3d0-e904-4d2f-8247-bd9a538f244c for instance 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 on hv-cinder-85604 Oct 06 12:35:52.830647 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f4a33abc-46ee-41f9-8085-39ebbce5656a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Going to try to terminate instance {{(pid=120508) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:35:52.831212 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-378bb4c1-0c0a-4910-a919-b20bf2d77e8f req-00d750d1-5998-4097-bc30-e00ee8a49b07 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045387 Oct 06 12:35:52.833026 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 578/1159] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:35:52.935180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f4a33abc-46ee-41f9-8085-39ebbce5656a tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "DELETE /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 204 len: 0 microversion: 2.1 time: 0.152984 Oct 06 12:35:52.937753 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 582/1160] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:35:52 2022] DELETE /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:35:52.948333 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f2b56166-d1e3-47b8-9069-c81c30a501ab tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:52.950341 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f2b56166-d1e3-47b8-9069-c81c30a501ab tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:52.963711 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f2b56166-d1e3-47b8-9069-c81c30a501ab tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:52.964202 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f2b56166-d1e3-47b8-9069-c81c30a501ab tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:52.964632 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f2b56166-d1e3-47b8-9069-c81c30a501ab tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:52.966355 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f2b56166-d1e3-47b8-9069-c81c30a501ab tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:52.967007 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f2b56166-d1e3-47b8-9069-c81c30a501ab tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:52.967430 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f2b56166-d1e3-47b8-9069-c81c30a501ab tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:53.130001 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f2b56166-d1e3-47b8-9069-c81c30a501ab tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:35:53.139885 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f2b56166-d1e3-47b8-9069-c81c30a501ab tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1576 microversion: 2.1 time: 0.196819 Oct 06 12:35:53.150820 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 579/1161] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:35:52 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:35:54.165392 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-bf4fa605-9e9c-4973-b18d-285de7426547 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:54.166298 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-bf4fa605-9e9c-4973-b18d-285de7426547 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:54.173485 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bf4fa605-9e9c-4973-b18d-285de7426547 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:54.174075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bf4fa605-9e9c-4973-b18d-285de7426547 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:54.174588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bf4fa605-9e9c-4973-b18d-285de7426547 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:54.175366 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bf4fa605-9e9c-4973-b18d-285de7426547 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:54.175856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bf4fa605-9e9c-4973-b18d-285de7426547 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:54.176294 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bf4fa605-9e9c-4973-b18d-285de7426547 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:54.416487 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-bf4fa605-9e9c-4973-b18d-285de7426547 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:35:54.424926 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-bf4fa605-9e9c-4973-b18d-285de7426547 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1576 microversion: 2.1 time: 0.263976 Oct 06 12:35:54.425594 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 583/1162] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:35:54 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1576 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:35:54.633568 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-cec0ff5d-1c51-4b72-b3f2-9a9347599175 req-f890261e-517e-4eac-8589-9ae5a71fed88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094", "name": "network-vif-deleted", "tag": "80e7b3d0-e904-4d2f-8247-bd9a538f244c"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:35:54.644707 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-cec0ff5d-1c51-4b72-b3f2-9a9347599175 req-f890261e-517e-4eac-8589-9ae5a71fed88 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:54.645191 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-cec0ff5d-1c51-4b72-b3f2-9a9347599175 req-f890261e-517e-4eac-8589-9ae5a71fed88 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:54.645624 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-cec0ff5d-1c51-4b72-b3f2-9a9347599175 req-f890261e-517e-4eac-8589-9ae5a71fed88 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:54.658322 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-cec0ff5d-1c51-4b72-b3f2-9a9347599175 req-f890261e-517e-4eac-8589-9ae5a71fed88 service nova] Creating event network-vif-deleted:80e7b3d0-e904-4d2f-8247-bd9a538f244c for instance 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 on hv-cinder-85604 Oct 06 12:35:54.663437 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-cec0ff5d-1c51-4b72-b3f2-9a9347599175 req-f890261e-517e-4eac-8589-9ae5a71fed88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033443 Oct 06 12:35:54.664407 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 580/1163] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:35:55.449030 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7e1809f1-05d5-4df7-8268-fdf53862b496 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:55.450003 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7e1809f1-05d5-4df7-8268-fdf53862b496 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:55.457757 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e1809f1-05d5-4df7-8268-fdf53862b496 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:55.458487 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e1809f1-05d5-4df7-8268-fdf53862b496 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:55.459140 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e1809f1-05d5-4df7-8268-fdf53862b496 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:55.460629 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e1809f1-05d5-4df7-8268-fdf53862b496 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:55.461379 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e1809f1-05d5-4df7-8268-fdf53862b496 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:55.462053 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e1809f1-05d5-4df7-8268-fdf53862b496 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:55.505152 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e1809f1-05d5-4df7-8268-fdf53862b496 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:55.505720 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e1809f1-05d5-4df7-8268-fdf53862b496 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:55.506163 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7e1809f1-05d5-4df7-8268-fdf53862b496 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:55.506614 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-7e1809f1-05d5-4df7-8268-fdf53862b496 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lazy-loading 'fault' on Instance uuid 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:35:55.548934 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7e1809f1-05d5-4df7-8268-fdf53862b496 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff0daad12c143fabd16d40a1939b87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80feb95ecbf413ca0bc52a519bf43b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:35:55.556768 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7e1809f1-05d5-4df7-8268-fdf53862b496 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 200 len: 1230 microversion: 2.1 time: 0.111985 Oct 06 12:35:55.557354 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 584/1164] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:35:55 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 1230 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:35:56.580893 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9dd8df37-9f27-48b2-8919-824ac36dbe95 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:56.581582 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9dd8df37-9f27-48b2-8919-824ac36dbe95 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:56.587694 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9dd8df37-9f27-48b2-8919-824ac36dbe95 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:56.588180 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9dd8df37-9f27-48b2-8919-824ac36dbe95 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:56.588613 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9dd8df37-9f27-48b2-8919-824ac36dbe95 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:56.589457 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9dd8df37-9f27-48b2-8919-824ac36dbe95 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:56.589977 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9dd8df37-9f27-48b2-8919-824ac36dbe95 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:56.590401 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9dd8df37-9f27-48b2-8919-824ac36dbe95 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:56.603614 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-9dd8df37-9f27-48b2-8919-824ac36dbe95 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] HTTP exception thrown: Instance 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 could not be found. Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9dd8df37-9f27-48b2-8919-824ac36dbe95 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Request method failure captured: Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 HTTP/1.1 Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPskuUx-wlgzCT7jVFY503HfgQZALsqMNcThj2AfG-b4jN2uZrnSDMB5RSgbFAUp_HzkY7gHKqtaUnqa5tZZ1ZQpDsbGSqYb1r2ZhZEZesbhgTxU5q2cWAmN80R4s-VeljjIEKovSZW9w-Plwe1BypUYEi5WPWLytPj8bKma4RUaIMwY Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: c80feb95ecbf413ca0bc52a519bf43b7 Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-TestVolumeBootPattern-152508398 Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:35:56.605251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:35:56.606897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c80feb95ecbf413ca0bc52a519bf43b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c80feb95ecbf413ca0bc52a519bf43b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c80feb95ecbf413ca0bc52a519bf43b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c80feb95ecbf413ca0bc52a519bf43b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:35:56.606897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-TestVolumeBootPattern-152508398 Oct 06 12:35:56.606897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: c80feb95ecbf413ca0bc52a519bf43b7 Oct 06 12:35:56.606897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-TestVolumeBootPattern-152508398 Oct 06 12:35:56.606897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-TestVolumeBootPattern-152508398-project Oct 06 12:35:56.606897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:35:56.606897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:35:56.606897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: dff0daad12c143fabd16d40a1939b87e Oct 06 12:35:56.606897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-TestVolumeBootPattern-152508398-project Oct 06 12:35:56.606897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:35:56.606897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 could not be found. Oct 06 12:35:56.606897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094'} Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 could not be found. Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:35:56.608515 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 could not be found. Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 could not be found. Oct 06 12:35:56.609957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:35:56.611458 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9dd8df37-9f27-48b2-8919-824ac36dbe95 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Returning 404 to user: Instance 82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:35:56.611458 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9dd8df37-9f27-48b2-8919-824ac36dbe95 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094" status: 404 len: 111 microversion: 2.1 time: 0.030434 Oct 06 12:35:56.611458 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 581/1165] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:35:56 2022] GET /compute/v2.1/servers/82c5f2bc-a2d3-4a7f-b6f9-bf919a92a094 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:35:57.049480 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d9910c16-5786-443b-8a0b-0228cb6d7400 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:57.050079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d9910c16-5786-443b-8a0b-0228cb6d7400 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:57.056540 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9910c16-5786-443b-8a0b-0228cb6d7400 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:57.057024 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9910c16-5786-443b-8a0b-0228cb6d7400 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:57.057464 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9910c16-5786-443b-8a0b-0228cb6d7400 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:57.058166 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9910c16-5786-443b-8a0b-0228cb6d7400 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:57.058812 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9910c16-5786-443b-8a0b-0228cb6d7400 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:57.059245 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d9910c16-5786-443b-8a0b-0228cb6d7400 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:57.072293 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-d9910c16-5786-443b-8a0b-0228cb6d7400 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] HTTP exception thrown: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d9910c16-5786-443b-8a0b-0228cb6d7400 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Request method failure captured: Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: DELETE /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae HTTP/1.1 Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPskuUx-wlgzCT7jVFY503HfgQZALsqMNcThj2AfG-b4jN2uZrnSDMB5RSgbFAUp_HzkY7gHKqtaUnqa5tZZ1ZQpDsbGSqYb1r2ZhZEZesbhgTxU5q2cWAmN80R4s-VeljjIEKovSZW9w-Plwe1BypUYEi5WPWLytPj8bKma4RUaIMwY Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: c80feb95ecbf413ca0bc52a519bf43b7 Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-TestVolumeBootPattern-152508398 Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:35:57.073882 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:35:57.075490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c80feb95ecbf413ca0bc52a519bf43b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c80feb95ecbf413ca0bc52a519bf43b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c80feb95ecbf413ca0bc52a519bf43b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c80feb95ecbf413ca0bc52a519bf43b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:35:57.075490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-TestVolumeBootPattern-152508398 Oct 06 12:35:57.075490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: c80feb95ecbf413ca0bc52a519bf43b7 Oct 06 12:35:57.075490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-TestVolumeBootPattern-152508398 Oct 06 12:35:57.075490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-TestVolumeBootPattern-152508398-project Oct 06 12:35:57.075490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:35:57.075490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:35:57.075490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: dff0daad12c143fabd16d40a1939b87e Oct 06 12:35:57.075490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-TestVolumeBootPattern-152508398-project Oct 06 12:35:57.075490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:35:57.075490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. Oct 06 12:35:57.075490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': 'a965adee-462e-4616-9ffe-bcb94e58c7ae'} Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:35:57.076364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. Oct 06 12:35:57.077686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:35:57.079296 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d9910c16-5786-443b-8a0b-0228cb6d7400 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Returning 404 to user: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:35:57.079296 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d9910c16-5786-443b-8a0b-0228cb6d7400 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 404 len: 111 microversion: 2.1 time: 0.030240 Oct 06 12:35:57.079296 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 585/1166] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:35:57 2022] DELETE /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:35:57.084171 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9a50a63b-bcc1-419c-aa73-6bf6bbf54378 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:35:57.084778 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9a50a63b-bcc1-419c-aa73-6bf6bbf54378 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] [instance: a965adee-462e-4616-9ffe-bcb94e58c7ae] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:35:57.090584 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9a50a63b-bcc1-419c-aa73-6bf6bbf54378 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:57.091062 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9a50a63b-bcc1-419c-aa73-6bf6bbf54378 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:57.091492 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9a50a63b-bcc1-419c-aa73-6bf6bbf54378 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:57.092727 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9a50a63b-bcc1-419c-aa73-6bf6bbf54378 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:35:57.093176 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9a50a63b-bcc1-419c-aa73-6bf6bbf54378 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:35:57.093596 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9a50a63b-bcc1-419c-aa73-6bf6bbf54378 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:35:57.106725 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-9a50a63b-bcc1-419c-aa73-6bf6bbf54378 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] HTTP exception thrown: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9a50a63b-bcc1-419c-aa73-6bf6bbf54378 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Request method failure captured: Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae HTTP/1.1 Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPskuUx-wlgzCT7jVFY503HfgQZALsqMNcThj2AfG-b4jN2uZrnSDMB5RSgbFAUp_HzkY7gHKqtaUnqa5tZZ1ZQpDsbGSqYb1r2ZhZEZesbhgTxU5q2cWAmN80R4s-VeljjIEKovSZW9w-Plwe1BypUYEi5WPWLytPj8bKma4RUaIMwY Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: c80feb95ecbf413ca0bc52a519bf43b7 Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-TestVolumeBootPattern-152508398 Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:35:57.108973 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:35:57.110738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c80feb95ecbf413ca0bc52a519bf43b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c80feb95ecbf413ca0bc52a519bf43b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c80feb95ecbf413ca0bc52a519bf43b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c80feb95ecbf413ca0bc52a519bf43b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:35:57.110738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-TestVolumeBootPattern-152508398 Oct 06 12:35:57.110738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: c80feb95ecbf413ca0bc52a519bf43b7 Oct 06 12:35:57.110738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-TestVolumeBootPattern-152508398 Oct 06 12:35:57.110738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-TestVolumeBootPattern-152508398-project Oct 06 12:35:57.110738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:35:57.110738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:35:57.110738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: dff0daad12c143fabd16d40a1939b87e Oct 06 12:35:57.110738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-TestVolumeBootPattern-152508398-project Oct 06 12:35:57.110738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:35:57.110738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. Oct 06 12:35:57.110738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': 'a965adee-462e-4616-9ffe-bcb94e58c7ae'} Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:35:57.114950 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. Oct 06 12:35:57.116526 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:35:57.117888 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9a50a63b-bcc1-419c-aa73-6bf6bbf54378 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Returning 404 to user: Instance a965adee-462e-4616-9ffe-bcb94e58c7ae could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:35:57.117888 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9a50a63b-bcc1-419c-aa73-6bf6bbf54378 tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae" status: 404 len: 111 microversion: 2.1 time: 0.030292 Oct 06 12:35:57.117888 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 582/1167] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:35:57 2022] GET /compute/v2.1/servers/a965adee-462e-4616-9ffe-bcb94e58c7ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:36:01.566216 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ba34ef10-3b62-4f2a-8ff6-b41a3ea7b1ea tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] Calling method '.version_select at 0x7f03aaee5c10>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:01.587042 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ba34ef10-3b62-4f2a-8ff6-b41a3ea7b1ea tempest-TestVolumeBootPattern-152508398 tempest-TestVolumeBootPattern-152508398-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-679794386" status: 202 len: 0 microversion: 2.1 time: 0.024453 Oct 06 12:36:01.588080 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 586/1168] 10.222.0.33 () {58 vars in 1260 bytes} [Thu Oct 6 12:36:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-679794386 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:36:39.572387 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-88bf5203-3f78-4bec-abf5-851110d44c94 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:39.572942 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-88bf5203-3f78-4bec-abf5-851110d44c94 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:39.574992 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=22 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:36:39.576374 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=38 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:36:39.577583 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 12:36:39.577743 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Thu Oct 6 12:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221/ips (ip 10.222.0.33) !!! Oct 06 12:36:39.587741 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88bf5203-3f78-4bec-abf5-851110d44c94 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:39.588223 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88bf5203-3f78-4bec-abf5-851110d44c94 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:39.588649 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88bf5203-3f78-4bec-abf5-851110d44c94 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:39.589363 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88bf5203-3f78-4bec-abf5-851110d44c94 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:39.589810 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88bf5203-3f78-4bec-abf5-851110d44c94 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:39.590226 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-88bf5203-3f78-4bec-abf5-851110d44c94 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:39.613183 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-88bf5203-3f78-4bec-abf5-851110d44c94 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221/ips" status: 200 len: 150 microversion: 2.1 time: 0.044759 Oct 06 12:36:39.613745 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 583/1169] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 12:36:39 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:36:39.625793 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-370a5608-3a81-42b0-95cc-5e18c9869fd6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91767071-c90c-460d-8792-2e4fb744d4c4"}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:36:39.628212 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-370a5608-3a81-42b0-95cc-5e18c9869fd6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:39.631257 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:36:39.632069 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 12:36:39.632201 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Thu Oct 6 12:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221/os-volume_attachments (ip 10.222.0.33) !!! Oct 06 12:36:39.633688 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:36:39.642825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-370a5608-3a81-42b0-95cc-5e18c9869fd6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:39.643315 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-370a5608-3a81-42b0-95cc-5e18c9869fd6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:39.643778 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-370a5608-3a81-42b0-95cc-5e18c9869fd6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:39.644478 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-370a5608-3a81-42b0-95cc-5e18c9869fd6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:39.644936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-370a5608-3a81-42b0-95cc-5e18c9869fd6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:39.645394 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-370a5608-3a81-42b0-95cc-5e18c9869fd6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:39.725549 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-370a5608-3a81-42b0-95cc-5e18c9869fd6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] HTTP exception thrown: Invalid volume: volume 91767071-c90c-460d-8792-2e4fb744d4c4 is already attached to instances: 82453bcd-3cd1-4cdc-b79a-88a352314608 Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-370a5608-3a81-42b0-95cc-5e18c9869fd6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Request method failure captured: Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: POST /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221/os-volume_attachments HTTP/1.1 Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 74 Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPsr0UNK1P5BhO28OBkcDUnSTA6CLARX6kiYEnj9_EsFiFVQzbi9_-NwZXrV3onBT0iZzu53Suft87ihWCMXUkJiHd9VthtJL9JTrWeTj4WwUlwrgkezgw1Mac-Yo3NoEL3SyrVpl_ar1oH1uwMuGD0iuYPnjIr5s5JetZyLhVFw4jdM Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:36:39.727149 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:36:39.728936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bee9f30f6e1d4d1ab2c4fe269d78d768", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:36:39.728936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:36:39.728936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:36:39.728936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:36:39.728936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:36:39.728936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:36:39.728936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:36:39.728936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 404c5e2b85454e1e91b90fa45796511e Oct 06 12:36:39.728936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:36:39.728936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Oct 06 12:36:39.728936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {"volumeAttachment": {"volumeId": "91767071-c90c-460d-8792-2e4fb744d4c4"}} Oct 06 12:36:39.728936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Invalid volume: volume 91767071-c90c-460d-8792-2e4fb744d4c4 is already attached to instances: 82453bcd-3cd1-4cdc-b79a-88a352314608 Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'server_id': '9aae47f4-74e0-47ee-8859-407ff1e7a221', 'body': {'volumeAttachment': {'volumeId': '91767071-c90c-460d-8792-2e4fb744d4c4'}}} Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 91767071-c90c-460d-8792-2e4fb744d4c4 is already attached to instances: 82453bcd-3cd1-4cdc-b79a-88a352314608 Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:36:39.729968 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 91767071-c90c-460d-8792-2e4fb744d4c4 is already attached to instances: 82453bcd-3cd1-4cdc-b79a-88a352314608 Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:36:39.731566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:36:39.733180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:36:39.733180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:36:39.733180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:36:39.733180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 91767071-c90c-460d-8792-2e4fb744d4c4 is already attached to instances: 82453bcd-3cd1-4cdc-b79a-88a352314608 Oct 06 12:36:39.733180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:36:39.733180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-370a5608-3a81-42b0-95cc-5e18c9869fd6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Returning 400 to user: Invalid volume: volume 91767071-c90c-460d-8792-2e4fb744d4c4 is already attached to instances: 82453bcd-3cd1-4cdc-b79a-88a352314608 {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:36:39.733180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-370a5608-3a81-42b0-95cc-5e18c9869fd6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "POST /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107448 Oct 06 12:36:39.733180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 587/1170] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 12:36:39 2022] POST /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:36:39.737194 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2f59d6e9-ffbc-4070-b4d9-a9d408ce5229 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:39.737685 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2f59d6e9-ffbc-4070-b4d9-a9d408ce5229 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:39.743499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f59d6e9-ffbc-4070-b4d9-a9d408ce5229 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:39.743999 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f59d6e9-ffbc-4070-b4d9-a9d408ce5229 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:39.744425 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f59d6e9-ffbc-4070-b4d9-a9d408ce5229 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:39.745097 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f59d6e9-ffbc-4070-b4d9-a9d408ce5229 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:39.745539 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f59d6e9-ffbc-4070-b4d9-a9d408ce5229 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:39.745953 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2f59d6e9-ffbc-4070-b4d9-a9d408ce5229 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:39.770915 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2f59d6e9-ffbc-4070-b4d9-a9d408ce5229 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Going to try to terminate instance {{(pid=120509) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:36:39.848904 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2f59d6e9-ffbc-4070-b4d9-a9d408ce5229 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 204 len: 0 microversion: 2.1 time: 0.115115 Oct 06 12:36:39.849451 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 584/1171] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:36:39 2022] DELETE /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:36:39.857667 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-573d63d2-b78b-4306-a8d3-c1209347ad38 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:39.858278 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-573d63d2-b78b-4306-a8d3-c1209347ad38 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:39.864263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-573d63d2-b78b-4306-a8d3-c1209347ad38 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:39.864761 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-573d63d2-b78b-4306-a8d3-c1209347ad38 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:39.865181 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-573d63d2-b78b-4306-a8d3-c1209347ad38 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:39.865872 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-573d63d2-b78b-4306-a8d3-c1209347ad38 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:39.866328 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-573d63d2-b78b-4306-a8d3-c1209347ad38 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:39.866752 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-573d63d2-b78b-4306-a8d3-c1209347ad38 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:39.993235 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-573d63d2-b78b-4306-a8d3-c1209347ad38 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:36:40.001557 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-573d63d2-b78b-4306-a8d3-c1209347ad38 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 200 len: 1683 microversion: 2.1 time: 0.147809 Oct 06 12:36:40.002120 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 588/1172] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:39 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:36:41.026810 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-43a79ff4-9c4a-4b63-a5bf-8e171d13d2b6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:41.027419 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-43a79ff4-9c4a-4b63-a5bf-8e171d13d2b6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:41.033961 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-43a79ff4-9c4a-4b63-a5bf-8e171d13d2b6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:41.034435 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-43a79ff4-9c4a-4b63-a5bf-8e171d13d2b6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:41.034866 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-43a79ff4-9c4a-4b63-a5bf-8e171d13d2b6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:41.035568 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-43a79ff4-9c4a-4b63-a5bf-8e171d13d2b6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:41.036018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-43a79ff4-9c4a-4b63-a5bf-8e171d13d2b6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:41.036438 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-43a79ff4-9c4a-4b63-a5bf-8e171d13d2b6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:41.164207 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-43a79ff4-9c4a-4b63-a5bf-8e171d13d2b6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:36:41.172665 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-43a79ff4-9c4a-4b63-a5bf-8e171d13d2b6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 200 len: 1683 microversion: 2.1 time: 0.150135 Oct 06 12:36:41.173287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 585/1173] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:41 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:36:42.195933 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c6010904-2692-4a25-944a-38d79b09cca5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:42.196555 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c6010904-2692-4a25-944a-38d79b09cca5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:42.203977 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6010904-2692-4a25-944a-38d79b09cca5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:42.204656 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6010904-2692-4a25-944a-38d79b09cca5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:42.205098 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6010904-2692-4a25-944a-38d79b09cca5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:42.205799 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6010904-2692-4a25-944a-38d79b09cca5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:42.206257 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6010904-2692-4a25-944a-38d79b09cca5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:42.206683 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c6010904-2692-4a25-944a-38d79b09cca5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:42.305800 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c6010904-2692-4a25-944a-38d79b09cca5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:36:42.313938 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c6010904-2692-4a25-944a-38d79b09cca5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 200 len: 1615 microversion: 2.1 time: 0.122268 Oct 06 12:36:42.314512 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 589/1174] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:42 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 1615 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:36:42.525257 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-c0c9287e-3fd8-4fee-9c93-2fb7fc7e39b1 req-9df619c4-5c2b-4fd2-9804-91eb4a0280a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aae47f4-74e0-47ee-8859-407ff1e7a221", "name": "network-vif-deleted", "tag": "df8efaa3-7d04-48a0-a529-0bdb59ee2149"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:36:42.537184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-c0c9287e-3fd8-4fee-9c93-2fb7fc7e39b1 req-9df619c4-5c2b-4fd2-9804-91eb4a0280a8 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:42.537656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-c0c9287e-3fd8-4fee-9c93-2fb7fc7e39b1 req-9df619c4-5c2b-4fd2-9804-91eb4a0280a8 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:42.538214 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-c0c9287e-3fd8-4fee-9c93-2fb7fc7e39b1 req-9df619c4-5c2b-4fd2-9804-91eb4a0280a8 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:42.551190 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-c0c9287e-3fd8-4fee-9c93-2fb7fc7e39b1 req-9df619c4-5c2b-4fd2-9804-91eb4a0280a8 service nova] Creating event network-vif-deleted:df8efaa3-7d04-48a0-a529-0bdb59ee2149 for instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 on hv-cinder-85604 Oct 06 12:36:42.557013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-c0c9287e-3fd8-4fee-9c93-2fb7fc7e39b1 req-9df619c4-5c2b-4fd2-9804-91eb4a0280a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035183 Oct 06 12:36:42.558232 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 586/1175] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:36:43.337831 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5744c54d-7e2b-4725-8dd3-be3d7016d55c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:43.338403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5744c54d-7e2b-4725-8dd3-be3d7016d55c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:43.345078 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5744c54d-7e2b-4725-8dd3-be3d7016d55c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:43.345805 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5744c54d-7e2b-4725-8dd3-be3d7016d55c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:43.346246 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5744c54d-7e2b-4725-8dd3-be3d7016d55c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:43.346951 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5744c54d-7e2b-4725-8dd3-be3d7016d55c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:43.347407 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5744c54d-7e2b-4725-8dd3-be3d7016d55c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:43.347858 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5744c54d-7e2b-4725-8dd3-be3d7016d55c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:43.361721 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-5744c54d-7e2b-4725-8dd3-be3d7016d55c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] HTTP exception thrown: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5744c54d-7e2b-4725-8dd3-be3d7016d55c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Request method failure captured: Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 HTTP/1.1 Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPsr0UNK1P5BhO28OBkcDUnSTA6CLARX6kiYEnj9_EsFiFVQzbi9_-NwZXrV3onBT0iZzu53Suft87ihWCMXUkJiHd9VthtJL9JTrWeTj4WwUlwrgkezgw1Mac-Yo3NoEL3SyrVpl_ar1oH1uwMuGD0iuYPnjIr5s5JetZyLhVFw4jdM Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:36:43.363340 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:36:43.364929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bee9f30f6e1d4d1ab2c4fe269d78d768", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:36:43.364929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:36:43.364929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:36:43.364929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:36:43.364929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:36:43.364929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:36:43.364929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:36:43.364929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 404c5e2b85454e1e91b90fa45796511e Oct 06 12:36:43.364929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:36:43.364929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:36:43.364929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. Oct 06 12:36:43.364929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '9aae47f4-74e0-47ee-8859-407ff1e7a221'} Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:36:43.365932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. Oct 06 12:36:43.367410 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:36:43.368663 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5744c54d-7e2b-4725-8dd3-be3d7016d55c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Returning 404 to user: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:36:43.368663 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5744c54d-7e2b-4725-8dd3-be3d7016d55c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 404 len: 111 microversion: 2.1 time: 0.030909 Oct 06 12:36:43.368663 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 590/1176] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:43 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:36:43.375175 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c758525d-7a00-496c-97ec-59a33594b94a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '.version_select at 0x7f03ae339af0>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:43.399828 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c758525d-7a00-496c-97ec-59a33594b94a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1500408061" status: 202 len: 0 microversion: 2.1 time: 0.029185 Oct 06 12:36:43.400739 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 587/1177] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Oct 6 12:36:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1500408061 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 12:36:44.057615 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-30e04e62-3925-4364-985c-d7cc5abbb9d6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:44.058093 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-30e04e62-3925-4364-985c-d7cc5abbb9d6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:44.064512 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-30e04e62-3925-4364-985c-d7cc5abbb9d6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:44.064999 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-30e04e62-3925-4364-985c-d7cc5abbb9d6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:44.065426 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-30e04e62-3925-4364-985c-d7cc5abbb9d6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:44.066157 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-30e04e62-3925-4364-985c-d7cc5abbb9d6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:44.066608 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-30e04e62-3925-4364-985c-d7cc5abbb9d6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:44.067029 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-30e04e62-3925-4364-985c-d7cc5abbb9d6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:44.145577 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-30e04e62-3925-4364-985c-d7cc5abbb9d6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lazy-loading 'services' on Instance uuid 82453bcd-3cd1-4cdc-b79a-88a352314608 {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:36:44.215233 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-30e04e62-3925-4364-985c-d7cc5abbb9d6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608/os-volume_attachments/91767071-c90c-460d-8792-2e4fb744d4c4" status: 202 len: 0 microversion: 2.1 time: 0.161354 Oct 06 12:36:44.215844 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 591/1178] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 12:36:44 2022] DELETE /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608/os-volume_attachments/91767071-c90c-460d-8792-2e4fb744d4c4 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:36:44.225602 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c5056968-e526-48cd-8199-8979272b297f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:44.228391 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c5056968-e526-48cd-8199-8979272b297f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:44.239119 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c5056968-e526-48cd-8199-8979272b297f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:44.239629 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c5056968-e526-48cd-8199-8979272b297f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:44.240272 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c5056968-e526-48cd-8199-8979272b297f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:44.240978 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c5056968-e526-48cd-8199-8979272b297f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:44.241430 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c5056968-e526-48cd-8199-8979272b297f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:44.242018 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c5056968-e526-48cd-8199-8979272b297f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:44.274980 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c5056968-e526-48cd-8199-8979272b297f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053520 Oct 06 12:36:44.275453 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 588/1179] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:36:44 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:36:45.288979 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-302e358e-556c-4152-8ee0-93a0ecd63001 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:45.291361 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-302e358e-556c-4152-8ee0-93a0ecd63001 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:45.298047 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-302e358e-556c-4152-8ee0-93a0ecd63001 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:45.298526 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-302e358e-556c-4152-8ee0-93a0ecd63001 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:45.298955 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-302e358e-556c-4152-8ee0-93a0ecd63001 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:45.299666 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-302e358e-556c-4152-8ee0-93a0ecd63001 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:45.300115 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-302e358e-556c-4152-8ee0-93a0ecd63001 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:45.300539 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-302e358e-556c-4152-8ee0-93a0ecd63001 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:45.329364 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-302e358e-556c-4152-8ee0-93a0ecd63001 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044840 Oct 06 12:36:45.329907 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 592/1180] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:36:45 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:36:45.390785 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c65b0d4f-1f9c-4b50-aaae-1853839ca96d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:45.391283 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c65b0d4f-1f9c-4b50-aaae-1853839ca96d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:45.397535 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c65b0d4f-1f9c-4b50-aaae-1853839ca96d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:45.398014 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c65b0d4f-1f9c-4b50-aaae-1853839ca96d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:45.398442 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c65b0d4f-1f9c-4b50-aaae-1853839ca96d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:45.399119 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c65b0d4f-1f9c-4b50-aaae-1853839ca96d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:45.399588 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c65b0d4f-1f9c-4b50-aaae-1853839ca96d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:45.400008 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c65b0d4f-1f9c-4b50-aaae-1853839ca96d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:45.424648 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c65b0d4f-1f9c-4b50-aaae-1853839ca96d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Going to try to terminate instance {{(pid=120509) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:36:45.498916 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c65b0d4f-1f9c-4b50-aaae-1853839ca96d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 204 len: 0 microversion: 2.1 time: 0.110661 Oct 06 12:36:45.499479 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 589/1181] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:36:45 2022] DELETE /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:36:45.508238 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8503b3bd-9e58-4411-bed6-7c4bdf1726fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:45.508850 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8503b3bd-9e58-4411-bed6-7c4bdf1726fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:45.514619 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8503b3bd-9e58-4411-bed6-7c4bdf1726fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:45.515105 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8503b3bd-9e58-4411-bed6-7c4bdf1726fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:45.515566 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8503b3bd-9e58-4411-bed6-7c4bdf1726fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:45.516288 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8503b3bd-9e58-4411-bed6-7c4bdf1726fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:45.516714 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8503b3bd-9e58-4411-bed6-7c4bdf1726fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:45.517136 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8503b3bd-9e58-4411-bed6-7c4bdf1726fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:45.644036 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8503b3bd-9e58-4411-bed6-7c4bdf1726fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:36:45.651815 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8503b3bd-9e58-4411-bed6-7c4bdf1726fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1681 microversion: 2.1 time: 0.147415 Oct 06 12:36:45.652381 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 593/1182] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:45 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:36:46.676583 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-127e7760-2874-4005-a4f8-d12063ba6667 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:46.677279 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-127e7760-2874-4005-a4f8-d12063ba6667 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:46.683711 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-127e7760-2874-4005-a4f8-d12063ba6667 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:46.684195 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-127e7760-2874-4005-a4f8-d12063ba6667 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:46.684632 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-127e7760-2874-4005-a4f8-d12063ba6667 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:46.685826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-127e7760-2874-4005-a4f8-d12063ba6667 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:46.686272 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-127e7760-2874-4005-a4f8-d12063ba6667 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:46.686693 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-127e7760-2874-4005-a4f8-d12063ba6667 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:46.815477 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-127e7760-2874-4005-a4f8-d12063ba6667 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:36:46.823066 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-127e7760-2874-4005-a4f8-d12063ba6667 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1681 microversion: 2.1 time: 0.150803 Oct 06 12:36:46.823652 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 590/1183] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:46 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:36:47.846719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-bbbd2092-f922-4d60-b103-19a92526cc0f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:47.847263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-bbbd2092-f922-4d60-b103-19a92526cc0f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:47.854704 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bbbd2092-f922-4d60-b103-19a92526cc0f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:47.855190 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bbbd2092-f922-4d60-b103-19a92526cc0f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:47.855655 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bbbd2092-f922-4d60-b103-19a92526cc0f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:47.856353 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bbbd2092-f922-4d60-b103-19a92526cc0f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:47.856807 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bbbd2092-f922-4d60-b103-19a92526cc0f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:47.857818 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-bbbd2092-f922-4d60-b103-19a92526cc0f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:48.047241 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-bbbd2092-f922-4d60-b103-19a92526cc0f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:36:48.055749 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-bbbd2092-f922-4d60-b103-19a92526cc0f tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 200 len: 1681 microversion: 2.1 time: 0.213085 Oct 06 12:36:48.056329 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 594/1184] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:47 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 1681 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:36:48.400304 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-a8dc9d1a-707e-4227-97fa-add3d8b53aa4 req-2d50a03f-2aba-497c-b738-4bc222f6ef72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82453bcd-3cd1-4cdc-b79a-88a352314608", "name": "network-vif-deleted", "tag": "14ef965e-071a-40af-81c7-0d464c9ac0d9"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:36:48.411970 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-a8dc9d1a-707e-4227-97fa-add3d8b53aa4 req-2d50a03f-2aba-497c-b738-4bc222f6ef72 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:48.412530 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-a8dc9d1a-707e-4227-97fa-add3d8b53aa4 req-2d50a03f-2aba-497c-b738-4bc222f6ef72 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:48.413023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-a8dc9d1a-707e-4227-97fa-add3d8b53aa4 req-2d50a03f-2aba-497c-b738-4bc222f6ef72 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:48.425130 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-a8dc9d1a-707e-4227-97fa-add3d8b53aa4 req-2d50a03f-2aba-497c-b738-4bc222f6ef72 service nova] Creating event network-vif-deleted:14ef965e-071a-40af-81c7-0d464c9ac0d9 for instance 82453bcd-3cd1-4cdc-b79a-88a352314608 on hv-cinder-85604 Oct 06 12:36:48.429939 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-a8dc9d1a-707e-4227-97fa-add3d8b53aa4 req-2d50a03f-2aba-497c-b738-4bc222f6ef72 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033677 Oct 06 12:36:48.430609 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 591/1185] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:36:49.078266 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-152f237d-27a7-4c07-9bbe-e31289be0c16 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:49.078892 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-152f237d-27a7-4c07-9bbe-e31289be0c16 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:49.085157 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-152f237d-27a7-4c07-9bbe-e31289be0c16 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:49.085675 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-152f237d-27a7-4c07-9bbe-e31289be0c16 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:49.086114 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-152f237d-27a7-4c07-9bbe-e31289be0c16 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:49.086806 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-152f237d-27a7-4c07-9bbe-e31289be0c16 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:49.087261 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-152f237d-27a7-4c07-9bbe-e31289be0c16 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:49.087716 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-152f237d-27a7-4c07-9bbe-e31289be0c16 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:49.101174 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-152f237d-27a7-4c07-9bbe-e31289be0c16 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] HTTP exception thrown: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-152f237d-27a7-4c07-9bbe-e31289be0c16 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Request method failure captured: Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 HTTP/1.1 Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPsr0UNK1P5BhO28OBkcDUnSTA6CLARX6kiYEnj9_EsFiFVQzbi9_-NwZXrV3onBT0iZzu53Suft87ihWCMXUkJiHd9VthtJL9JTrWeTj4WwUlwrgkezgw1Mac-Yo3NoEL3SyrVpl_ar1oH1uwMuGD0iuYPnjIr5s5JetZyLhVFw4jdM Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:36:49.102817 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:36:49.104514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bee9f30f6e1d4d1ab2c4fe269d78d768", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:36:49.104514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:36:49.104514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:36:49.104514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:36:49.104514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:36:49.104514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:36:49.104514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:36:49.104514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 404c5e2b85454e1e91b90fa45796511e Oct 06 12:36:49.104514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:36:49.104514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:36:49.104514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. Oct 06 12:36:49.104514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '82453bcd-3cd1-4cdc-b79a-88a352314608'} Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:36:49.105443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. Oct 06 12:36:49.106965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:36:49.109965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-152f237d-27a7-4c07-9bbe-e31289be0c16 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Returning 404 to user: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:36:49.109965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-152f237d-27a7-4c07-9bbe-e31289be0c16 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 404 len: 111 microversion: 2.1 time: 0.029964 Oct 06 12:36:49.109965 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 595/1186] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:49 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:36:49.116378 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-313c2d94-40a9-4771-8772-69ec06ee958a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '.version_select at 0x7f03ae32bd30>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:49.135803 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-313c2d94-40a9-4771-8772-69ec06ee958a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488367870" status: 202 len: 0 microversion: 2.1 time: 0.024072 Oct 06 12:36:49.136479 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 592/1187] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Oct 6 12:36:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488367870 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:36:49.755949 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c2b2c947-4d31-45bd-a3b4-2c8a39d0843b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Action: 'create', calling method: .version_select at 0x7f03aabc9d30>, body: {"keypair": {"name": "tempest-keypair-2031764615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+I2/LlEkOifL5ZQ4bsovUza1Kk9ZWuTeOrIyQhIuXQPKjUuSN1dEGMDR28PW4mbOK1+2IYjSl/NjO8cmB0kJxwaz1z3XN/ftGlMY9SdcsXqyZj1WTi2eIdX+A7XS6Luw=="}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:36:49.771041 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-c2b2c947-4d31-45bd-a3b4-2c8a39d0843b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'key_pairs'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:36:49.774796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-c2b2c947-4d31-45bd-a3b4-2c8a39d0843b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for user 404c5e2b85454e1e91b90fa45796511e and project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'key_pairs'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:36:49.796361 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c2b2c947-4d31-45bd-a3b4-2c8a39d0843b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044431 Oct 06 12:36:49.796932 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 596/1188] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 12:36:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:36:51.023019 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-206560237", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "466556a2-70ae-47ab-beee-c79927eef272"}], "security_groups": [{"name": "tempest-securitygroup--488619891"}], "key_name": "tempest-keypair-2031764615", "user_data": "}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:36:51.128699 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.network.neutron [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] validate_networks() for [('466556a2-70ae-47ab-beee-c79927eef272', None, None, None, None, None)] {{(pid=120509) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:36:51.716146 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Flavor limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:36:51.717186 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Image limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:36:51.717657 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Flavor pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:36:51.718067 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Image pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:36:51.718473 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:36:51.727055 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:51.727556 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:51.727994 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:51.728714 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:51.729164 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:51.729584 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:51.746207 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:36:51.750131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for user 404c5e2b85454e1e91b90fa45796511e and project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:36:51.761364 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Going to run 1 instances... {{(pid=120509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:36:51.763813 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:36:51.810855 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9635bee2-478b-4982-86f4-a1ae57319c5e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.792673 Oct 06 12:36:51.811432 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 593/1189] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:36:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:36:51.822982 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7587998b-999f-4cb8-9f3a-33e6c4133fef tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:51.823635 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7587998b-999f-4cb8-9f3a-33e6c4133fef tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:51.882259 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7587998b-999f-4cb8-9f3a-33e6c4133fef tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:36:51.889192 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7587998b-999f-4cb8-9f3a-33e6c4133fef tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 200 len: 1241 microversion: 2.1 time: 0.070532 Oct 06 12:36:51.889765 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 597/1190] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:51 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:36:52.913544 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9150f58a-079b-4d1a-8de3-9d151b68c280 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:52.914782 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9150f58a-079b-4d1a-8de3-9d151b68c280 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:52.922326 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9150f58a-079b-4d1a-8de3-9d151b68c280 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:52.923024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9150f58a-079b-4d1a-8de3-9d151b68c280 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:52.923734 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9150f58a-079b-4d1a-8de3-9d151b68c280 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:52.924664 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9150f58a-079b-4d1a-8de3-9d151b68c280 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:52.925124 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9150f58a-079b-4d1a-8de3-9d151b68c280 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:52.925550 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9150f58a-079b-4d1a-8de3-9d151b68c280 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:53.005703 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9150f58a-079b-4d1a-8de3-9d151b68c280 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:36:53.013274 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9150f58a-079b-4d1a-8de3-9d151b68c280 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 200 len: 1311 microversion: 2.1 time: 0.104150 Oct 06 12:36:53.013846 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 594/1191] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:52 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:36:54.037002 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c9c12044-f789-47ed-8639-d081b1006a96 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:54.037541 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c9c12044-f789-47ed-8639-d081b1006a96 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:54.044024 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c9c12044-f789-47ed-8639-d081b1006a96 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:54.044516 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c9c12044-f789-47ed-8639-d081b1006a96 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:54.044967 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c9c12044-f789-47ed-8639-d081b1006a96 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:54.045765 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c9c12044-f789-47ed-8639-d081b1006a96 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:54.046341 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c9c12044-f789-47ed-8639-d081b1006a96 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:54.046771 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c9c12044-f789-47ed-8639-d081b1006a96 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:54.267757 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c9c12044-f789-47ed-8639-d081b1006a96 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:36:54.275899 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c9c12044-f789-47ed-8639-d081b1006a96 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 200 len: 1366 microversion: 2.1 time: 0.243163 Oct 06 12:36:54.276474 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 598/1192] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:54 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:36:54.387784 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-376b09c8-2b68-453b-be1a-d050c4c1a272 req-b118af7a-8aa9-4112-8968-009169f90593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9", "tag": "a3874053-8164-4b60-8a91-38e7f5ea86ad"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:36:54.397659 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-376b09c8-2b68-453b-be1a-d050c4c1a272 req-b118af7a-8aa9-4112-8968-009169f90593 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:54.398126 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-376b09c8-2b68-453b-be1a-d050c4c1a272 req-b118af7a-8aa9-4112-8968-009169f90593 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:54.398548 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-376b09c8-2b68-453b-be1a-d050c4c1a272 req-b118af7a-8aa9-4112-8968-009169f90593 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:54.410111 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-376b09c8-2b68-453b-be1a-d050c4c1a272 req-b118af7a-8aa9-4112-8968-009169f90593 service nova] Creating event network-changed:a3874053-8164-4b60-8a91-38e7f5ea86ad for instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 on hv-cinder-85604 Oct 06 12:36:54.415131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-376b09c8-2b68-453b-be1a-d050c4c1a272 req-b118af7a-8aa9-4112-8968-009169f90593 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031086 Oct 06 12:36:54.415774 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 595/1193] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:36:55.299575 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8fd9613b-c4c8-4d0e-83f0-a9eaf9de63fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:55.300190 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8fd9613b-c4c8-4d0e-83f0-a9eaf9de63fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:55.306463 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8fd9613b-c4c8-4d0e-83f0-a9eaf9de63fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:55.306947 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8fd9613b-c4c8-4d0e-83f0-a9eaf9de63fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:55.307387 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8fd9613b-c4c8-4d0e-83f0-a9eaf9de63fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:55.308103 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8fd9613b-c4c8-4d0e-83f0-a9eaf9de63fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:55.308560 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8fd9613b-c4c8-4d0e-83f0-a9eaf9de63fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:55.308986 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8fd9613b-c4c8-4d0e-83f0-a9eaf9de63fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:55.435300 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8fd9613b-c4c8-4d0e-83f0-a9eaf9de63fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:36:55.443493 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8fd9613b-c4c8-4d0e-83f0-a9eaf9de63fe tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 200 len: 1366 microversion: 2.1 time: 0.147967 Oct 06 12:36:55.444079 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 599/1194] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:55 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:36:56.467669 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-27e2f54b-20a1-4c4b-b8f2-d611e291953e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:56.468366 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-27e2f54b-20a1-4c4b-b8f2-d611e291953e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:56.475170 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-27e2f54b-20a1-4c4b-b8f2-d611e291953e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:56.475689 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-27e2f54b-20a1-4c4b-b8f2-d611e291953e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:56.476121 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-27e2f54b-20a1-4c4b-b8f2-d611e291953e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:56.476803 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-27e2f54b-20a1-4c4b-b8f2-d611e291953e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:56.477249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-27e2f54b-20a1-4c4b-b8f2-d611e291953e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:56.477667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-27e2f54b-20a1-4c4b-b8f2-d611e291953e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:56.606073 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-27e2f54b-20a1-4c4b-b8f2-d611e291953e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:36:56.613725 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-27e2f54b-20a1-4c4b-b8f2-d611e291953e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 200 len: 1366 microversion: 2.1 time: 0.150831 Oct 06 12:36:56.614283 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 596/1195] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:56 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:36:57.636233 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-77fc27a6-2d3f-41d1-b06b-2bc3c056c9d1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:57.636849 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-77fc27a6-2d3f-41d1-b06b-2bc3c056c9d1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:57.643800 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77fc27a6-2d3f-41d1-b06b-2bc3c056c9d1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:57.644281 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77fc27a6-2d3f-41d1-b06b-2bc3c056c9d1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:57.644714 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77fc27a6-2d3f-41d1-b06b-2bc3c056c9d1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:57.645401 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77fc27a6-2d3f-41d1-b06b-2bc3c056c9d1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:57.645861 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77fc27a6-2d3f-41d1-b06b-2bc3c056c9d1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:57.646288 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-77fc27a6-2d3f-41d1-b06b-2bc3c056c9d1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:57.774833 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-77fc27a6-2d3f-41d1-b06b-2bc3c056c9d1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:36:57.782498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-77fc27a6-2d3f-41d1-b06b-2bc3c056c9d1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 200 len: 1366 microversion: 2.1 time: 0.150194 Oct 06 12:36:57.783070 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 600/1196] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:57 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:36:58.805609 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-09a69c0b-c9ab-46b0-9ebd-f2d21c791300 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:58.806245 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-09a69c0b-c9ab-46b0-9ebd-f2d21c791300 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:58.813294 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09a69c0b-c9ab-46b0-9ebd-f2d21c791300 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:58.813765 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09a69c0b-c9ab-46b0-9ebd-f2d21c791300 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:58.814194 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09a69c0b-c9ab-46b0-9ebd-f2d21c791300 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:58.814871 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09a69c0b-c9ab-46b0-9ebd-f2d21c791300 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:58.815316 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09a69c0b-c9ab-46b0-9ebd-f2d21c791300 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:58.815765 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09a69c0b-c9ab-46b0-9ebd-f2d21c791300 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:58.947103 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-09a69c0b-c9ab-46b0-9ebd-f2d21c791300 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:36:58.954634 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-09a69c0b-c9ab-46b0-9ebd-f2d21c791300 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 200 len: 1366 microversion: 2.1 time: 0.152925 Oct 06 12:36:58.955192 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 597/1197] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:58 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:36:59.977490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-005db274-e21f-4541-b8f0-e71f47b45722 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:36:59.978102 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-005db274-e21f-4541-b8f0-e71f47b45722 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:36:59.985000 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-005db274-e21f-4541-b8f0-e71f47b45722 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:59.985689 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-005db274-e21f-4541-b8f0-e71f47b45722 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:59.986282 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-005db274-e21f-4541-b8f0-e71f47b45722 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:36:59.987075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-005db274-e21f-4541-b8f0-e71f47b45722 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:36:59.987555 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-005db274-e21f-4541-b8f0-e71f47b45722 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:36:59.987987 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-005db274-e21f-4541-b8f0-e71f47b45722 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:00.121510 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-005db274-e21f-4541-b8f0-e71f47b45722 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:37:00.129533 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-005db274-e21f-4541-b8f0-e71f47b45722 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 200 len: 1366 microversion: 2.1 time: 0.155915 Oct 06 12:37:00.130099 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 601/1198] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:36:59 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:37:01.153105 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c6fcbc3e-cff9-4f5f-aa4e-0818eea27c72 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:37:01.153720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c6fcbc3e-cff9-4f5f-aa4e-0818eea27c72 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:37:01.160974 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6fcbc3e-cff9-4f5f-aa4e-0818eea27c72 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:01.161455 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6fcbc3e-cff9-4f5f-aa4e-0818eea27c72 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:01.161891 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6fcbc3e-cff9-4f5f-aa4e-0818eea27c72 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:01.162580 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6fcbc3e-cff9-4f5f-aa4e-0818eea27c72 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:01.163032 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6fcbc3e-cff9-4f5f-aa4e-0818eea27c72 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:01.163458 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-c6fcbc3e-cff9-4f5f-aa4e-0818eea27c72 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:01.291160 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c6fcbc3e-cff9-4f5f-aa4e-0818eea27c72 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:37:01.298727 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c6fcbc3e-cff9-4f5f-aa4e-0818eea27c72 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 200 len: 1366 microversion: 2.1 time: 0.149585 Oct 06 12:37:01.299292 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 598/1199] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:37:01 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:37:01.748210 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-c27a8f05-7087-4d52-8c06-604d5e71409b req-e6c9235a-ed08-4ba7-afea-a449b4408404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9", "name": "network-vif-plugged", "status": "completed", "tag": "a3874053-8164-4b60-8a91-38e7f5ea86ad"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:37:01.759235 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-c27a8f05-7087-4d52-8c06-604d5e71409b req-e6c9235a-ed08-4ba7-afea-a449b4408404 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:01.759745 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-c27a8f05-7087-4d52-8c06-604d5e71409b req-e6c9235a-ed08-4ba7-afea-a449b4408404 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:01.760173 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-c27a8f05-7087-4d52-8c06-604d5e71409b req-e6c9235a-ed08-4ba7-afea-a449b4408404 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:01.771013 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-c27a8f05-7087-4d52-8c06-604d5e71409b req-e6c9235a-ed08-4ba7-afea-a449b4408404 service nova] Creating event network-vif-plugged:a3874053-8164-4b60-8a91-38e7f5ea86ad for instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 on hv-cinder-85604 Oct 06 12:37:01.775877 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-c27a8f05-7087-4d52-8c06-604d5e71409b req-e6c9235a-ed08-4ba7-afea-a449b4408404 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031384 Oct 06 12:37:01.776907 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 602/1200] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:37:02.322451 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b351c1e9-b690-456c-af49-b35bfb5bab3a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:37:02.323055 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b351c1e9-b690-456c-af49-b35bfb5bab3a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:37:02.325027 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:37:02.325685 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=6 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:37:02.332586 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b351c1e9-b690-456c-af49-b35bfb5bab3a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:02.333067 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b351c1e9-b690-456c-af49-b35bfb5bab3a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:02.333503 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b351c1e9-b690-456c-af49-b35bfb5bab3a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:02.334184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b351c1e9-b690-456c-af49-b35bfb5bab3a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:02.334635 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b351c1e9-b690-456c-af49-b35bfb5bab3a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:02.335052 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b351c1e9-b690-456c-af49-b35bfb5bab3a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:02.460013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b351c1e9-b690-456c-af49-b35bfb5bab3a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:37:02.467458 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b351c1e9-b690-456c-af49-b35bfb5bab3a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 200 len: 1366 microversion: 2.1 time: 0.148992 Oct 06 12:37:02.468068 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 599/1201] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:37:02 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:37:03.487762 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=6 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:37:03.492514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8bb66d78-9027-49cb-a4e8-369d5c794dfb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:37:03.493241 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8bb66d78-9027-49cb-a4e8-369d5c794dfb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:37:03.499552 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8bb66d78-9027-49cb-a4e8-369d5c794dfb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:03.499977 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8bb66d78-9027-49cb-a4e8-369d5c794dfb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:03.500406 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8bb66d78-9027-49cb-a4e8-369d5c794dfb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:03.501082 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8bb66d78-9027-49cb-a4e8-369d5c794dfb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:03.501531 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8bb66d78-9027-49cb-a4e8-369d5c794dfb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:03.501946 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8bb66d78-9027-49cb-a4e8-369d5c794dfb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:03.630089 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8bb66d78-9027-49cb-a4e8-369d5c794dfb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:37:03.637656 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8bb66d78-9027-49cb-a4e8-369d5c794dfb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 200 len: 1366 microversion: 2.1 time: 0.150890 Oct 06 12:37:03.638233 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 603/1202] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:37:03 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:37:04.661938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7707dba0-315f-4245-971c-ac12764a6afb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:37:04.662548 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7707dba0-315f-4245-971c-ac12764a6afb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:37:04.668910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7707dba0-315f-4245-971c-ac12764a6afb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:04.669391 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7707dba0-315f-4245-971c-ac12764a6afb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:04.669825 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7707dba0-315f-4245-971c-ac12764a6afb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:04.670509 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7707dba0-315f-4245-971c-ac12764a6afb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:04.670956 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7707dba0-315f-4245-971c-ac12764a6afb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:04.671379 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7707dba0-315f-4245-971c-ac12764a6afb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:04.798202 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7707dba0-315f-4245-971c-ac12764a6afb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:37:04.805765 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7707dba0-315f-4245-971c-ac12764a6afb tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 200 len: 1557 microversion: 2.1 time: 0.148049 Oct 06 12:37:04.806341 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 600/1203] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:37:04 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:37:04.828499 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-573e525c-8a4c-4212-8e40-881840dd079d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:37:04.829024 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-573e525c-8a4c-4212-8e40-881840dd079d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:37:04.835263 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-573e525c-8a4c-4212-8e40-881840dd079d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:04.835779 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-573e525c-8a4c-4212-8e40-881840dd079d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:04.836211 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-573e525c-8a4c-4212-8e40-881840dd079d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:04.836889 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-573e525c-8a4c-4212-8e40-881840dd079d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:04.837336 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-573e525c-8a4c-4212-8e40-881840dd079d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:04.837754 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-573e525c-8a4c-4212-8e40-881840dd079d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:04.912275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-573e525c-8a4c-4212-8e40-881840dd079d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088056 Oct 06 12:37:04.912842 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 604/1204] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 12:37:04 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:37:05.806019 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-86441654-c9fe-40d9-bfe5-73c5d1ef205e req-dd106562-d6ca-4cee-95a3-687bcaa1515f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9", "tag": "a3874053-8164-4b60-8a91-38e7f5ea86ad"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:37:05.816267 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-86441654-c9fe-40d9-bfe5-73c5d1ef205e req-dd106562-d6ca-4cee-95a3-687bcaa1515f service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:05.816745 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-86441654-c9fe-40d9-bfe5-73c5d1ef205e req-dd106562-d6ca-4cee-95a3-687bcaa1515f service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:05.817174 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-86441654-c9fe-40d9-bfe5-73c5d1ef205e req-dd106562-d6ca-4cee-95a3-687bcaa1515f service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:05.826299 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:37:05.829225 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-86441654-c9fe-40d9-bfe5-73c5d1ef205e req-dd106562-d6ca-4cee-95a3-687bcaa1515f service nova] Creating event network-changed:a3874053-8164-4b60-8a91-38e7f5ea86ad for instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 on hv-cinder-85604 Oct 06 12:37:05.834713 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-86441654-c9fe-40d9-bfe5-73c5d1ef205e req-dd106562-d6ca-4cee-95a3-687bcaa1515f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032396 Oct 06 12:37:05.835469 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 601/1205] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:38:20.729551 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:38:20.730931 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:38:20.852014 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-95f9f26c-72ca-4e7f-813a-daa4570753ec tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:20.852505 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-95f9f26c-72ca-4e7f-813a-daa4570753ec tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:20.859031 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95f9f26c-72ca-4e7f-813a-daa4570753ec tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:20.859538 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95f9f26c-72ca-4e7f-813a-daa4570753ec tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:20.859974 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95f9f26c-72ca-4e7f-813a-daa4570753ec tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:20.860657 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95f9f26c-72ca-4e7f-813a-daa4570753ec tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:20.861722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95f9f26c-72ca-4e7f-813a-daa4570753ec tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:20.862147 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-95f9f26c-72ca-4e7f-813a-daa4570753ec tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:20.885726 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-95f9f26c-72ca-4e7f-813a-daa4570753ec tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9/ips" status: 200 len: 151 microversion: 2.1 time: 0.158069 Oct 06 12:38:20.886282 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 605/1206] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 12:38:20 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9/ips => generated 151 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:38:22.223245 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:38:22.229534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3d7f27f2-3d52-4a15-bf29-96d9ad2faa55 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b310378e-e3a4-4ee3-82fc-43d1f77589e2"}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:38:22.231993 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3d7f27f2-3d52-4a15-bf29-96d9ad2faa55 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:22.240459 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d7f27f2-3d52-4a15-bf29-96d9ad2faa55 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:22.240935 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d7f27f2-3d52-4a15-bf29-96d9ad2faa55 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:22.241362 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d7f27f2-3d52-4a15-bf29-96d9ad2faa55 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:22.242047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d7f27f2-3d52-4a15-bf29-96d9ad2faa55 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:22.242490 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d7f27f2-3d52-4a15-bf29-96d9ad2faa55 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:22.242910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3d7f27f2-3d52-4a15-bf29-96d9ad2faa55 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:22.608774 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3d7f27f2-3d52-4a15-bf29-96d9ad2faa55 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "POST /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387846 Oct 06 12:38:22.609396 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 602/1207] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 12:38:22 2022] POST /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:38:30.143813 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d89ece8c-b39f-4c5d-b97b-d5de2e340c9a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b310378e-e3a4-4ee3-82fc-43d1f77589e2"}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:38:30.146241 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d89ece8c-b39f-4c5d-b97b-d5de2e340c9a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:30.152573 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d89ece8c-b39f-4c5d-b97b-d5de2e340c9a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:30.153057 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d89ece8c-b39f-4c5d-b97b-d5de2e340c9a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:30.153496 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d89ece8c-b39f-4c5d-b97b-d5de2e340c9a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:30.154184 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d89ece8c-b39f-4c5d-b97b-d5de2e340c9a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:30.154642 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d89ece8c-b39f-4c5d-b97b-d5de2e340c9a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:30.155069 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d89ece8c-b39f-4c5d-b97b-d5de2e340c9a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:30.281068 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-d89ece8c-b39f-4c5d-b97b-d5de2e340c9a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] HTTP exception thrown: Invalid volume: volume b310378e-e3a4-4ee3-82fc-43d1f77589e2 is already attached to instances: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d89ece8c-b39f-4c5d-b97b-d5de2e340c9a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Request method failure captured: Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: POST /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9/os-volume_attachments HTTP/1.1 Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 74 Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPsr0UNK1P5BhO28OBkcDUnSTA6CLARX6kiYEnj9_EsFiFVQzbi9_-NwZXrV3onBT0iZzu53Suft87ihWCMXUkJiHd9VthtJL9JTrWeTj4WwUlwrgkezgw1Mac-Yo3NoEL3SyrVpl_ar1oH1uwMuGD0iuYPnjIr5s5JetZyLhVFw4jdM Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:38:30.282722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:38:30.284582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bee9f30f6e1d4d1ab2c4fe269d78d768", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:38:30.284582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:38:30.284582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:38:30.284582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:38:30.284582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:38:30.284582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:38:30.284582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:38:30.284582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 404c5e2b85454e1e91b90fa45796511e Oct 06 12:38:30.284582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:38:30.284582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Oct 06 12:38:30.284582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {"volumeAttachment": {"volumeId": "b310378e-e3a4-4ee3-82fc-43d1f77589e2"}} Oct 06 12:38:30.284582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Invalid volume: volume b310378e-e3a4-4ee3-82fc-43d1f77589e2 is already attached to instances: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'server_id': '4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9', 'body': {'volumeAttachment': {'volumeId': 'b310378e-e3a4-4ee3-82fc-43d1f77589e2'}}} Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b310378e-e3a4-4ee3-82fc-43d1f77589e2 is already attached to instances: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:38:30.285836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b310378e-e3a4-4ee3-82fc-43d1f77589e2 is already attached to instances: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:38:30.287168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:38:30.288593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:38:30.288593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:38:30.288593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:38:30.288593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b310378e-e3a4-4ee3-82fc-43d1f77589e2 is already attached to instances: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 Oct 06 12:38:30.288593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:38:30.288593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d89ece8c-b39f-4c5d-b97b-d5de2e340c9a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Returning 400 to user: Invalid volume: volume b310378e-e3a4-4ee3-82fc-43d1f77589e2 is already attached to instances: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:38:30.288593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d89ece8c-b39f-4c5d-b97b-d5de2e340c9a tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "POST /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.144484 Oct 06 12:38:30.288593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 606/1208] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 12:38:30 2022] POST /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9/os-volume_attachments => generated 174 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:38:30.350112 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-09e94eff-6527-45ce-81e4-9ad6933e9b70 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:30.350696 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-09e94eff-6527-45ce-81e4-9ad6933e9b70 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:30.356767 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09e94eff-6527-45ce-81e4-9ad6933e9b70 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:30.357252 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09e94eff-6527-45ce-81e4-9ad6933e9b70 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:30.357686 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09e94eff-6527-45ce-81e4-9ad6933e9b70 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:30.358367 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09e94eff-6527-45ce-81e4-9ad6933e9b70 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:30.358815 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09e94eff-6527-45ce-81e4-9ad6933e9b70 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:30.359234 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09e94eff-6527-45ce-81e4-9ad6933e9b70 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:30.438178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-09e94eff-6527-45ce-81e4-9ad6933e9b70 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lazy-loading 'services' on Instance uuid 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:38:30.508835 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-09e94eff-6527-45ce-81e4-9ad6933e9b70 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9/os-volume_attachments/b310378e-e3a4-4ee3-82fc-43d1f77589e2" status: 202 len: 0 microversion: 2.1 time: 0.163325 Oct 06 12:38:30.509435 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 603/1209] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 12:38:30 2022] DELETE /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9/os-volume_attachments/b310378e-e3a4-4ee3-82fc-43d1f77589e2 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:38:30.518512 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-fe14c623-1cd3-45a2-935a-c8e62c7491ff tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:30.520734 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-fe14c623-1cd3-45a2-935a-c8e62c7491ff tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:30.526656 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fe14c623-1cd3-45a2-935a-c8e62c7491ff tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:30.527045 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fe14c623-1cd3-45a2-935a-c8e62c7491ff tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:30.527482 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fe14c623-1cd3-45a2-935a-c8e62c7491ff tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:30.528269 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fe14c623-1cd3-45a2-935a-c8e62c7491ff tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:30.528686 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fe14c623-1cd3-45a2-935a-c8e62c7491ff tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:30.529468 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fe14c623-1cd3-45a2-935a-c8e62c7491ff tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:30.559893 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-fe14c623-1cd3-45a2-935a-c8e62c7491ff tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045845 Oct 06 12:38:30.560370 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 607/1210] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:38:30 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:38:31.573111 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-48224c39-384b-42c9-ab4d-3d8acf17e049 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:31.575467 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-48224c39-384b-42c9-ab4d-3d8acf17e049 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:31.582098 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48224c39-384b-42c9-ab4d-3d8acf17e049 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:31.582575 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48224c39-384b-42c9-ab4d-3d8acf17e049 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:31.583007 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48224c39-384b-42c9-ab4d-3d8acf17e049 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:31.583722 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48224c39-384b-42c9-ab4d-3d8acf17e049 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:31.584178 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48224c39-384b-42c9-ab4d-3d8acf17e049 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:31.584602 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-48224c39-384b-42c9-ab4d-3d8acf17e049 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:31.613246 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-48224c39-384b-42c9-ab4d-3d8acf17e049 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044914 Oct 06 12:38:31.613793 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 604/1211] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:38:31 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:38:31.675599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-5ed0a293-d185-4eeb-a7b2-557e5a9cce81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:31.676070 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5ed0a293-d185-4eeb-a7b2-557e5a9cce81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:31.682347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5ed0a293-d185-4eeb-a7b2-557e5a9cce81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:31.682821 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5ed0a293-d185-4eeb-a7b2-557e5a9cce81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:31.683248 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5ed0a293-d185-4eeb-a7b2-557e5a9cce81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:31.683962 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5ed0a293-d185-4eeb-a7b2-557e5a9cce81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:31.684408 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5ed0a293-d185-4eeb-a7b2-557e5a9cce81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:31.684827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-5ed0a293-d185-4eeb-a7b2-557e5a9cce81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:31.709461 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-5ed0a293-d185-4eeb-a7b2-557e5a9cce81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Going to try to terminate instance {{(pid=120508) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:38:31.782634 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-5ed0a293-d185-4eeb-a7b2-557e5a9cce81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 204 len: 0 microversion: 2.1 time: 0.110371 Oct 06 12:38:31.783489 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 608/1212] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:38:31 2022] DELETE /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:38:31.794273 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-05660774-8e08-4fec-8ecc-0b146dd22a1e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:31.794879 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-05660774-8e08-4fec-8ecc-0b146dd22a1e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:31.800788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-05660774-8e08-4fec-8ecc-0b146dd22a1e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:31.801262 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-05660774-8e08-4fec-8ecc-0b146dd22a1e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:31.801693 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-05660774-8e08-4fec-8ecc-0b146dd22a1e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:31.802368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-05660774-8e08-4fec-8ecc-0b146dd22a1e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:31.802813 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-05660774-8e08-4fec-8ecc-0b146dd22a1e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:31.803234 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-05660774-8e08-4fec-8ecc-0b146dd22a1e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:31.932805 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-05660774-8e08-4fec-8ecc-0b146dd22a1e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:38:31.941013 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-05660774-8e08-4fec-8ecc-0b146dd22a1e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 200 len: 1682 microversion: 2.1 time: 0.151896 Oct 06 12:38:31.941574 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 605/1213] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:38:31 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:38:32.966770 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e15d1533-322b-43d7-870e-da3c4735cab2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:32.967455 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e15d1533-322b-43d7-870e-da3c4735cab2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:32.973736 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e15d1533-322b-43d7-870e-da3c4735cab2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:32.974221 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e15d1533-322b-43d7-870e-da3c4735cab2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:32.974655 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e15d1533-322b-43d7-870e-da3c4735cab2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:32.975343 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e15d1533-322b-43d7-870e-da3c4735cab2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:32.975831 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e15d1533-322b-43d7-870e-da3c4735cab2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:32.976255 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e15d1533-322b-43d7-870e-da3c4735cab2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:33.100535 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e15d1533-322b-43d7-870e-da3c4735cab2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:38:33.108052 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e15d1533-322b-43d7-870e-da3c4735cab2 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 200 len: 1682 microversion: 2.1 time: 0.145526 Oct 06 12:38:33.108625 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 609/1214] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:38:32 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:38:34.132368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f27a665b-4d68-45a4-90b0-4ccb104e5d6c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:34.132983 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f27a665b-4d68-45a4-90b0-4ccb104e5d6c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:34.139828 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f27a665b-4d68-45a4-90b0-4ccb104e5d6c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:34.140316 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f27a665b-4d68-45a4-90b0-4ccb104e5d6c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:34.140755 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f27a665b-4d68-45a4-90b0-4ccb104e5d6c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:34.141449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f27a665b-4d68-45a4-90b0-4ccb104e5d6c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:34.141905 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f27a665b-4d68-45a4-90b0-4ccb104e5d6c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:34.142332 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f27a665b-4d68-45a4-90b0-4ccb104e5d6c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:34.598263 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f27a665b-4d68-45a4-90b0-4ccb104e5d6c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:38:34.606174 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f27a665b-4d68-45a4-90b0-4ccb104e5d6c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 200 len: 1682 microversion: 2.1 time: 0.478421 Oct 06 12:38:34.606958 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 606/1215] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:38:34 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 1682 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:38:34.982109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-7f933d81-4391-4004-b60d-f2f6517a03d5 req-0b67175c-c514-44f2-8685-de42754a8d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9", "name": "network-vif-deleted", "tag": "a3874053-8164-4b60-8a91-38e7f5ea86ad"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:38:34.992349 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-7f933d81-4391-4004-b60d-f2f6517a03d5 req-0b67175c-c514-44f2-8685-de42754a8d2b service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:34.992830 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-7f933d81-4391-4004-b60d-f2f6517a03d5 req-0b67175c-c514-44f2-8685-de42754a8d2b service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:34.993262 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-7f933d81-4391-4004-b60d-f2f6517a03d5 req-0b67175c-c514-44f2-8685-de42754a8d2b service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:35.008172 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-7f933d81-4391-4004-b60d-f2f6517a03d5 req-0b67175c-c514-44f2-8685-de42754a8d2b service nova] Creating event network-vif-deleted:a3874053-8164-4b60-8a91-38e7f5ea86ad for instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 on hv-cinder-85604 Oct 06 12:38:35.013804 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-7f933d81-4391-4004-b60d-f2f6517a03d5 req-0b67175c-c514-44f2-8685-de42754a8d2b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035288 Oct 06 12:38:35.015685 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 610/1216] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:38:35.630153 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b5dbfda5-4434-4c1b-9e9c-263111af0bb8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:35.630819 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b5dbfda5-4434-4c1b-9e9c-263111af0bb8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:35.637062 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b5dbfda5-4434-4c1b-9e9c-263111af0bb8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:35.637540 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b5dbfda5-4434-4c1b-9e9c-263111af0bb8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:35.637974 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b5dbfda5-4434-4c1b-9e9c-263111af0bb8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:35.638675 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b5dbfda5-4434-4c1b-9e9c-263111af0bb8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:35.639116 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b5dbfda5-4434-4c1b-9e9c-263111af0bb8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:35.639554 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b5dbfda5-4434-4c1b-9e9c-263111af0bb8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:35.652853 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-b5dbfda5-4434-4c1b-9e9c-263111af0bb8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] HTTP exception thrown: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b5dbfda5-4434-4c1b-9e9c-263111af0bb8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Request method failure captured: Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 HTTP/1.1 Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsr0UNK1P5BhO28OBkcDUnSTA6CLARX6kiYEnj9_EsFiFVQzbi9_-NwZXrV3onBT0iZzu53Suft87ihWCMXUkJiHd9VthtJL9JTrWeTj4WwUlwrgkezgw1Mac-Yo3NoEL3SyrVpl_ar1oH1uwMuGD0iuYPnjIr5s5JetZyLhVFw4jdM Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:38:35.654534 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:38:35.656536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bee9f30f6e1d4d1ab2c4fe269d78d768", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:38:35.656536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:38:35.656536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:38:35.656536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:38:35.656536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:38:35.656536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:38:35.656536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:38:35.656536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 404c5e2b85454e1e91b90fa45796511e Oct 06 12:38:35.656536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:38:35.656536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:38:35.656536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. Oct 06 12:38:35.656536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9'} Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:38:35.657667 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. Oct 06 12:38:35.659368 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:38:35.661796 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b5dbfda5-4434-4c1b-9e9c-263111af0bb8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Returning 404 to user: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:38:35.662647 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b5dbfda5-4434-4c1b-9e9c-263111af0bb8 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 404 len: 111 microversion: 2.1 time: 0.037035 Oct 06 12:38:35.663180 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 607/1217] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:38:35 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:38:35.672017 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e483b000-a792-41dc-9b87-9ac40e47a533 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '.version_select at 0x7f03aaee5af0>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:35.692137 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e483b000-a792-41dc-9b87-9ac40e47a533 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2031764615" status: 202 len: 0 microversion: 2.1 time: 0.024213 Oct 06 12:38:35.692713 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 611/1218] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Oct 6 12:38:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2031764615 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 12:38:36.312269 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5069c912-595e-4142-a533-77317fb4d7f5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Action: 'create', calling method: .version_select at 0x7f03aac61310>, body: {"keypair": {"name": "tempest-keypair-2118256570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUlGjeFO8LlgSw4bX6oIfPwC2c/xCSZQrFKpVK8+QXq4FdToGUHKQbd/ifuCAjA7OWn81g4EOkPLwJQOfIJBopv4nH+wfI964uthIIYdxd5yEU0E6hBD+XGumH6k0MlOw=="}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:38:36.327661 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-5069c912-595e-4142-a533-77317fb4d7f5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'key_pairs'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:38:36.332286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-5069c912-595e-4142-a533-77317fb4d7f5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for user 404c5e2b85454e1e91b90fa45796511e and project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'key_pairs'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:38:36.354585 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5069c912-595e-4142-a533-77317fb4d7f5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046233 Oct 06 12:38:36.355169 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 608/1219] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 12:38:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:38:37.555361 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1380025351", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "466556a2-70ae-47ab-beee-c79927eef272"}], "security_groups": [{"name": "tempest-securitygroup--1390971175"}], "key_name": "tempest-keypair-2118256570", "user_data": "}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:38:37.655747 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.network.neutron [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] validate_networks() for [('466556a2-70ae-47ab-beee-c79927eef272', None, None, None, None, None)] {{(pid=120508) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:38:38.055068 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Flavor limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:38:38.055485 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Image limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:38:38.055981 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Flavor pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:38:38.056386 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Image pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:38:38.056796 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:38:38.065970 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:38.066445 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:38.066878 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:38.067618 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:38.068070 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:38.068491 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:38.085343 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:38:38.089247 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Getting quotas for user 404c5e2b85454e1e91b90fa45796511e and project bee9f30f6e1d4d1ab2c4fe269d78d768. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:38:38.099933 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Going to run 1 instances... {{(pid=120508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:38:38.102210 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:38:38.150999 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-66f8ee6d-c700-4455-aae1-d9eec6cd359d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.600277 Oct 06 12:38:38.151974 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 612/1220] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:38:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 12:38:38.163047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-c6a7970c-67f6-4a52-bb44-f531a1b6551d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:38.163691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-c6a7970c-67f6-4a52-bb44-f531a1b6551d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:38.224009 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-c6a7970c-67f6-4a52-bb44-f531a1b6551d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:38:38.231181 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-c6a7970c-67f6-4a52-bb44-f531a1b6551d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 200 len: 1242 microversion: 2.1 time: 0.072303 Oct 06 12:38:38.231775 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 609/1221] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:38:38 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:38:39.254276 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f6713f00-e581-4d6b-9887-8008f953ac84 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:39.255589 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f6713f00-e581-4d6b-9887-8008f953ac84 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:39.262689 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6713f00-e581-4d6b-9887-8008f953ac84 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:39.263171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6713f00-e581-4d6b-9887-8008f953ac84 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:39.263629 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6713f00-e581-4d6b-9887-8008f953ac84 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:39.264328 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6713f00-e581-4d6b-9887-8008f953ac84 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:39.264775 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6713f00-e581-4d6b-9887-8008f953ac84 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:39.265196 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f6713f00-e581-4d6b-9887-8008f953ac84 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:39.325734 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f6713f00-e581-4d6b-9887-8008f953ac84 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:38:39.333843 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f6713f00-e581-4d6b-9887-8008f953ac84 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 200 len: 1294 microversion: 2.1 time: 0.084001 Oct 06 12:38:39.334611 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 613/1222] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:38:39 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:38:40.357885 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b3596670-6133-4893-8ab8-e04c0050c2e6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:40.358524 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b3596670-6133-4893-8ab8-e04c0050c2e6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:40.366036 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b3596670-6133-4893-8ab8-e04c0050c2e6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:40.366527 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b3596670-6133-4893-8ab8-e04c0050c2e6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:40.366971 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b3596670-6133-4893-8ab8-e04c0050c2e6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:40.367736 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b3596670-6133-4893-8ab8-e04c0050c2e6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:40.368200 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b3596670-6133-4893-8ab8-e04c0050c2e6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:40.368631 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b3596670-6133-4893-8ab8-e04c0050c2e6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:40.551012 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b3596670-6133-4893-8ab8-e04c0050c2e6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:38:40.558742 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b3596670-6133-4893-8ab8-e04c0050c2e6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 200 len: 1368 microversion: 2.1 time: 0.204836 Oct 06 12:38:40.559320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 610/1223] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:38:40 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:38:40.882875 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-2edcd1bd-b18c-4f85-abde-57cda87c32ef req-af68d8f2-6d8e-4ed5-bdf2-20a7dfbc389f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "365eefdd-0377-4569-8684-30f8dc19ef9d", "tag": "e555afd2-d7ca-452f-b30a-cd726c904b32"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:38:40.895074 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-2edcd1bd-b18c-4f85-abde-57cda87c32ef req-af68d8f2-6d8e-4ed5-bdf2-20a7dfbc389f service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:40.895974 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-2edcd1bd-b18c-4f85-abde-57cda87c32ef req-af68d8f2-6d8e-4ed5-bdf2-20a7dfbc389f service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:40.896422 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-2edcd1bd-b18c-4f85-abde-57cda87c32ef req-af68d8f2-6d8e-4ed5-bdf2-20a7dfbc389f service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:40.907798 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-2edcd1bd-b18c-4f85-abde-57cda87c32ef req-af68d8f2-6d8e-4ed5-bdf2-20a7dfbc389f service nova] Creating event network-changed:e555afd2-d7ca-452f-b30a-cd726c904b32 for instance 365eefdd-0377-4569-8684-30f8dc19ef9d on hv-cinder-85604 Oct 06 12:38:40.913770 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-2edcd1bd-b18c-4f85-abde-57cda87c32ef req-af68d8f2-6d8e-4ed5-bdf2-20a7dfbc389f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035784 Oct 06 12:38:40.914576 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 614/1224] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:38:41.582739 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-71c64de2-60ba-4edb-a401-e30f03a7609b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:41.583297 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-71c64de2-60ba-4edb-a401-e30f03a7609b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:41.589683 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71c64de2-60ba-4edb-a401-e30f03a7609b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:41.590226 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71c64de2-60ba-4edb-a401-e30f03a7609b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:41.590653 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71c64de2-60ba-4edb-a401-e30f03a7609b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:41.591327 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71c64de2-60ba-4edb-a401-e30f03a7609b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:41.591821 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71c64de2-60ba-4edb-a401-e30f03a7609b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:41.592237 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-71c64de2-60ba-4edb-a401-e30f03a7609b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:41.722067 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-71c64de2-60ba-4edb-a401-e30f03a7609b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:38:41.729503 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-71c64de2-60ba-4edb-a401-e30f03a7609b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 200 len: 1368 microversion: 2.1 time: 0.150731 Oct 06 12:38:41.730062 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 611/1225] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:38:41 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:38:42.753802 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f42e8a3c-6a75-4fff-9678-8e4b09ea3170 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:42.754497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f42e8a3c-6a75-4fff-9678-8e4b09ea3170 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:42.761038 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f42e8a3c-6a75-4fff-9678-8e4b09ea3170 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:42.761514 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f42e8a3c-6a75-4fff-9678-8e4b09ea3170 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:42.761944 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f42e8a3c-6a75-4fff-9678-8e4b09ea3170 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:42.762631 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f42e8a3c-6a75-4fff-9678-8e4b09ea3170 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:42.763080 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f42e8a3c-6a75-4fff-9678-8e4b09ea3170 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:42.763499 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f42e8a3c-6a75-4fff-9678-8e4b09ea3170 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:42.889639 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f42e8a3c-6a75-4fff-9678-8e4b09ea3170 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:38:42.897280 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f42e8a3c-6a75-4fff-9678-8e4b09ea3170 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 200 len: 1368 microversion: 2.1 time: 0.148652 Oct 06 12:38:42.897834 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 615/1226] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:38:42 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:38:43.920251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-fe795357-47a7-4a73-91a2-64b05e90e772 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:43.920861 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-fe795357-47a7-4a73-91a2-64b05e90e772 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:43.927152 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe795357-47a7-4a73-91a2-64b05e90e772 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:43.927690 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe795357-47a7-4a73-91a2-64b05e90e772 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:43.928124 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe795357-47a7-4a73-91a2-64b05e90e772 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:43.928803 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe795357-47a7-4a73-91a2-64b05e90e772 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:43.929253 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe795357-47a7-4a73-91a2-64b05e90e772 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:43.929674 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fe795357-47a7-4a73-91a2-64b05e90e772 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:44.057818 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fe795357-47a7-4a73-91a2-64b05e90e772 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:38:44.065868 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-fe795357-47a7-4a73-91a2-64b05e90e772 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 200 len: 1368 microversion: 2.1 time: 0.149523 Oct 06 12:38:44.066434 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 612/1227] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:38:43 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:38:45.087731 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f7393a96-5eef-4563-a2e6-e9ec4fe57e0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:45.088256 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f7393a96-5eef-4563-a2e6-e9ec4fe57e0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:45.094425 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7393a96-5eef-4563-a2e6-e9ec4fe57e0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:45.094908 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7393a96-5eef-4563-a2e6-e9ec4fe57e0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:45.095341 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7393a96-5eef-4563-a2e6-e9ec4fe57e0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:45.096067 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7393a96-5eef-4563-a2e6-e9ec4fe57e0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:45.097187 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7393a96-5eef-4563-a2e6-e9ec4fe57e0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:45.097614 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f7393a96-5eef-4563-a2e6-e9ec4fe57e0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:45.220265 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f7393a96-5eef-4563-a2e6-e9ec4fe57e0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:38:45.228504 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f7393a96-5eef-4563-a2e6-e9ec4fe57e0b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 200 len: 1368 microversion: 2.1 time: 0.144789 Oct 06 12:38:45.229067 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 616/1228] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:38:45 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:38:46.251686 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9b52a2fc-e111-4fab-ac14-bc322ceb39b5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:46.252180 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9b52a2fc-e111-4fab-ac14-bc322ceb39b5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:46.258557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9b52a2fc-e111-4fab-ac14-bc322ceb39b5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:46.259047 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9b52a2fc-e111-4fab-ac14-bc322ceb39b5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:46.259484 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9b52a2fc-e111-4fab-ac14-bc322ceb39b5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:46.260205 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9b52a2fc-e111-4fab-ac14-bc322ceb39b5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:46.260661 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9b52a2fc-e111-4fab-ac14-bc322ceb39b5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:46.261088 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9b52a2fc-e111-4fab-ac14-bc322ceb39b5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:46.389679 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9b52a2fc-e111-4fab-ac14-bc322ceb39b5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:38:46.397297 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9b52a2fc-e111-4fab-ac14-bc322ceb39b5 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 200 len: 1368 microversion: 2.1 time: 0.149968 Oct 06 12:38:46.398208 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 613/1229] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:38:46 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:38:46.468179 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-b358dd30-9598-4237-b4a9-c2672bfae6b5 req-86e8cb55-b2b8-4f59-9478-e10ef28f10c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365eefdd-0377-4569-8684-30f8dc19ef9d", "name": "network-vif-plugged", "status": "completed", "tag": "e555afd2-d7ca-452f-b30a-cd726c904b32"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:38:46.478285 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-b358dd30-9598-4237-b4a9-c2672bfae6b5 req-86e8cb55-b2b8-4f59-9478-e10ef28f10c8 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:46.478758 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-b358dd30-9598-4237-b4a9-c2672bfae6b5 req-86e8cb55-b2b8-4f59-9478-e10ef28f10c8 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:46.479184 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-b358dd30-9598-4237-b4a9-c2672bfae6b5 req-86e8cb55-b2b8-4f59-9478-e10ef28f10c8 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:46.490687 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-b358dd30-9598-4237-b4a9-c2672bfae6b5 req-86e8cb55-b2b8-4f59-9478-e10ef28f10c8 service nova] Creating event network-vif-plugged:e555afd2-d7ca-452f-b30a-cd726c904b32 for instance 365eefdd-0377-4569-8684-30f8dc19ef9d on hv-cinder-85604 Oct 06 12:38:46.495612 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-b358dd30-9598-4237-b4a9-c2672bfae6b5 req-86e8cb55-b2b8-4f59-9478-e10ef28f10c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094132 Oct 06 12:38:46.496267 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 617/1230] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:38:47.421997 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-fa92043b-1e9e-4bee-81be-47cd1920c01b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:47.422599 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-fa92043b-1e9e-4bee-81be-47cd1920c01b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:47.429563 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fa92043b-1e9e-4bee-81be-47cd1920c01b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:47.430034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fa92043b-1e9e-4bee-81be-47cd1920c01b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:47.430483 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fa92043b-1e9e-4bee-81be-47cd1920c01b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:47.431154 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fa92043b-1e9e-4bee-81be-47cd1920c01b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:47.431623 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fa92043b-1e9e-4bee-81be-47cd1920c01b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:47.432038 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-fa92043b-1e9e-4bee-81be-47cd1920c01b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:47.561812 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-fa92043b-1e9e-4bee-81be-47cd1920c01b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:38:47.569955 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-fa92043b-1e9e-4bee-81be-47cd1920c01b tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 200 len: 1368 microversion: 2.1 time: 0.151809 Oct 06 12:38:47.570525 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 614/1231] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:38:47 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:38:48.590471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:38:48.591222 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=6 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:38:48.595451 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-e1835f5f-0fe0-40e4-bc8e-a90451f18f44 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:48.596172 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-e1835f5f-0fe0-40e4-bc8e-a90451f18f44 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:48.603007 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e1835f5f-0fe0-40e4-bc8e-a90451f18f44 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:48.603488 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e1835f5f-0fe0-40e4-bc8e-a90451f18f44 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:48.603936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e1835f5f-0fe0-40e4-bc8e-a90451f18f44 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:48.604618 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e1835f5f-0fe0-40e4-bc8e-a90451f18f44 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:48.605059 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e1835f5f-0fe0-40e4-bc8e-a90451f18f44 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:48.605484 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-e1835f5f-0fe0-40e4-bc8e-a90451f18f44 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:48.734073 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-e1835f5f-0fe0-40e4-bc8e-a90451f18f44 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:38:48.741641 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-e1835f5f-0fe0-40e4-bc8e-a90451f18f44 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 200 len: 1559 microversion: 2.1 time: 0.152559 Oct 06 12:38:48.742206 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 618/1232] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:38:48 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:38:48.764061 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-09da28db-bbb9-4bb4-a57a-625239a9bc01 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:48.764588 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-09da28db-bbb9-4bb4-a57a-625239a9bc01 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:38:48.766462 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=6 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:38:48.772803 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09da28db-bbb9-4bb4-a57a-625239a9bc01 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:48.773630 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09da28db-bbb9-4bb4-a57a-625239a9bc01 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:48.773734 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09da28db-bbb9-4bb4-a57a-625239a9bc01 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:48.774408 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09da28db-bbb9-4bb4-a57a-625239a9bc01 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:48.774859 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09da28db-bbb9-4bb4-a57a-625239a9bc01 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:48.775302 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-09da28db-bbb9-4bb4-a57a-625239a9bc01 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:48.850784 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-09da28db-bbb9-4bb4-a57a-625239a9bc01 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090486 Oct 06 12:38:48.851383 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 615/1233] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 12:38:48 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:38:49.982606 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-0d144254-1392-4bda-a0ff-214febca37b9 req-104df8f9-e1e8-4f4a-ac4f-6adba003a331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "365eefdd-0377-4569-8684-30f8dc19ef9d", "tag": "e555afd2-d7ca-452f-b30a-cd726c904b32"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:38:49.992447 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-0d144254-1392-4bda-a0ff-214febca37b9 req-104df8f9-e1e8-4f4a-ac4f-6adba003a331 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:38:49.992920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-0d144254-1392-4bda-a0ff-214febca37b9 req-104df8f9-e1e8-4f4a-ac4f-6adba003a331 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:38:49.993347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-0d144254-1392-4bda-a0ff-214febca37b9 req-104df8f9-e1e8-4f4a-ac4f-6adba003a331 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:38:50.004613 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-0d144254-1392-4bda-a0ff-214febca37b9 req-104df8f9-e1e8-4f4a-ac4f-6adba003a331 service nova] Creating event network-changed:e555afd2-d7ca-452f-b30a-cd726c904b32 for instance 365eefdd-0377-4569-8684-30f8dc19ef9d on hv-cinder-85604 Oct 06 12:38:50.009520 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-0d144254-1392-4bda-a0ff-214febca37b9 req-104df8f9-e1e8-4f4a-ac4f-6adba003a331 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030532 Oct 06 12:38:50.010115 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 619/1234] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:40:04.933734 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:40:04.934562 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:40:04.935468 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 12:40:04.935634 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Thu Oct 6 12:40:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d/ips (ip 10.222.0.33) !!! Oct 06 12:40:04.947171 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-1ef30ee3-7e95-4014-9e96-53e27cb9732c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:04.948193 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-1ef30ee3-7e95-4014-9e96-53e27cb9732c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:04.956590 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1ef30ee3-7e95-4014-9e96-53e27cb9732c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:04.957066 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1ef30ee3-7e95-4014-9e96-53e27cb9732c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:04.957494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1ef30ee3-7e95-4014-9e96-53e27cb9732c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:04.958171 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1ef30ee3-7e95-4014-9e96-53e27cb9732c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:04.958617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1ef30ee3-7e95-4014-9e96-53e27cb9732c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:04.959039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-1ef30ee3-7e95-4014-9e96-53e27cb9732c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:04.982541 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-1ef30ee3-7e95-4014-9e96-53e27cb9732c tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d/ips" status: 200 len: 151 microversion: 2.1 time: 0.050837 Oct 06 12:40:04.983094 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 616/1235] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 12:40:04 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:40:06.309398 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:40:06.310213 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:40:06.315585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f090ea83-8f8d-4b74-80ca-14d6e6d720fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd8e9db6-c583-4c38-a672-5399b2c7bc17"}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:40:06.318000 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f090ea83-8f8d-4b74-80ca-14d6e6d720fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:06.330119 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f090ea83-8f8d-4b74-80ca-14d6e6d720fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:06.330609 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f090ea83-8f8d-4b74-80ca-14d6e6d720fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:06.331046 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f090ea83-8f8d-4b74-80ca-14d6e6d720fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:06.331778 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f090ea83-8f8d-4b74-80ca-14d6e6d720fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:06.332236 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f090ea83-8f8d-4b74-80ca-14d6e6d720fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:06.332663 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f090ea83-8f8d-4b74-80ca-14d6e6d720fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:06.593992 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f090ea83-8f8d-4b74-80ca-14d6e6d720fd tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "POST /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286499 Oct 06 12:40:06.594647 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 620/1236] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 12:40:06 2022] POST /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:40:14.437636 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-4ae0a9ff-f9db-46ad-92e1-4b39408a1a97 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:14.438266 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-4ae0a9ff-f9db-46ad-92e1-4b39408a1a97 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:14.445733 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ae0a9ff-f9db-46ad-92e1-4b39408a1a97 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:14.446222 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ae0a9ff-f9db-46ad-92e1-4b39408a1a97 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:14.446658 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ae0a9ff-f9db-46ad-92e1-4b39408a1a97 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:14.447875 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ae0a9ff-f9db-46ad-92e1-4b39408a1a97 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:14.448398 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ae0a9ff-f9db-46ad-92e1-4b39408a1a97 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:14.448828 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-4ae0a9ff-f9db-46ad-92e1-4b39408a1a97 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:14.533123 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-4ae0a9ff-f9db-46ad-92e1-4b39408a1a97 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lazy-loading 'services' on Instance uuid 365eefdd-0377-4569-8684-30f8dc19ef9d {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:40:14.616538 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-4ae0a9ff-f9db-46ad-92e1-4b39408a1a97 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d/os-volume_attachments/dd8e9db6-c583-4c38-a672-5399b2c7bc17" status: 202 len: 0 microversion: 2.1 time: 0.184028 Oct 06 12:40:14.617670 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 617/1237] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 12:40:14 2022] DELETE /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d/os-volume_attachments/dd8e9db6-c583-4c38-a672-5399b2c7bc17 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:40:14.628036 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-a4292728-bbf9-4a5e-a988-c973554434ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:14.630459 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-a4292728-bbf9-4a5e-a988-c973554434ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:14.637672 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a4292728-bbf9-4a5e-a988-c973554434ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:14.638165 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a4292728-bbf9-4a5e-a988-c973554434ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:14.638615 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a4292728-bbf9-4a5e-a988-c973554434ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:14.639315 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a4292728-bbf9-4a5e-a988-c973554434ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:14.639836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a4292728-bbf9-4a5e-a988-c973554434ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:14.640278 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-a4292728-bbf9-4a5e-a988-c973554434ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:14.672423 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-a4292728-bbf9-4a5e-a988-c973554434ae tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049511 Oct 06 12:40:14.672990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 621/1238] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:40:14 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:40:15.685806 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-3f4e6d6a-f878-49a4-ab11-ddf193966427 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:15.688150 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-3f4e6d6a-f878-49a4-ab11-ddf193966427 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:15.694773 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3f4e6d6a-f878-49a4-ab11-ddf193966427 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:15.695243 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3f4e6d6a-f878-49a4-ab11-ddf193966427 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:15.695707 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3f4e6d6a-f878-49a4-ab11-ddf193966427 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:15.696380 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3f4e6d6a-f878-49a4-ab11-ddf193966427 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:15.696825 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3f4e6d6a-f878-49a4-ab11-ddf193966427 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:15.697240 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-3f4e6d6a-f878-49a4-ab11-ddf193966427 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:15.725547 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-3f4e6d6a-f878-49a4-ab11-ddf193966427 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044154 Oct 06 12:40:15.726087 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 618/1239] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 12:40:15 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:40:15.787463 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-62b03922-9a52-4485-a007-6fa6a1fb2cd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:15.787990 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-62b03922-9a52-4485-a007-6fa6a1fb2cd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:15.794959 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-62b03922-9a52-4485-a007-6fa6a1fb2cd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:15.795444 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-62b03922-9a52-4485-a007-6fa6a1fb2cd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:15.795900 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-62b03922-9a52-4485-a007-6fa6a1fb2cd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:15.796592 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-62b03922-9a52-4485-a007-6fa6a1fb2cd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:15.797044 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-62b03922-9a52-4485-a007-6fa6a1fb2cd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:15.797465 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-62b03922-9a52-4485-a007-6fa6a1fb2cd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:15.821706 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-62b03922-9a52-4485-a007-6fa6a1fb2cd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Going to try to terminate instance {{(pid=120508) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:40:15.895405 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-62b03922-9a52-4485-a007-6fa6a1fb2cd9 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 204 len: 0 microversion: 2.1 time: 0.111545 Oct 06 12:40:15.896404 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 622/1240] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:40:15 2022] DELETE /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:40:15.905094 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-9e7652a0-9d4a-4ccd-828c-1cc3315a00e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:15.905697 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-9e7652a0-9d4a-4ccd-828c-1cc3315a00e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:15.911756 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e7652a0-9d4a-4ccd-828c-1cc3315a00e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:15.912231 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e7652a0-9d4a-4ccd-828c-1cc3315a00e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:15.912658 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e7652a0-9d4a-4ccd-828c-1cc3315a00e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:15.913332 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e7652a0-9d4a-4ccd-828c-1cc3315a00e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:15.913773 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e7652a0-9d4a-4ccd-828c-1cc3315a00e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:15.914187 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-9e7652a0-9d4a-4ccd-828c-1cc3315a00e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:16.041164 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-9e7652a0-9d4a-4ccd-828c-1cc3315a00e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:40:16.048805 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-9e7652a0-9d4a-4ccd-828c-1cc3315a00e0 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 200 len: 1684 microversion: 2.1 time: 0.147646 Oct 06 12:40:16.049363 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 619/1241] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:40:15 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:40:17.072430 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-f206f18f-25ce-47fb-928c-37e9e9cbe1ea tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:17.073141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-f206f18f-25ce-47fb-928c-37e9e9cbe1ea tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:17.079545 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f206f18f-25ce-47fb-928c-37e9e9cbe1ea tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:17.080033 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f206f18f-25ce-47fb-928c-37e9e9cbe1ea tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:17.080469 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f206f18f-25ce-47fb-928c-37e9e9cbe1ea tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:17.081200 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f206f18f-25ce-47fb-928c-37e9e9cbe1ea tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:17.081659 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f206f18f-25ce-47fb-928c-37e9e9cbe1ea tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:17.082088 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-f206f18f-25ce-47fb-928c-37e9e9cbe1ea tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:17.213339 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-f206f18f-25ce-47fb-928c-37e9e9cbe1ea tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:40:17.221012 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-f206f18f-25ce-47fb-928c-37e9e9cbe1ea tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 200 len: 1684 microversion: 2.1 time: 0.152823 Oct 06 12:40:17.221583 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 623/1242] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:40:17 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:40:18.244712 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2adb3644-c23a-4f50-bf5e-863c83599d81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:18.245111 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2adb3644-c23a-4f50-bf5e-863c83599d81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:18.251863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2adb3644-c23a-4f50-bf5e-863c83599d81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:18.252351 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2adb3644-c23a-4f50-bf5e-863c83599d81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:18.252783 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2adb3644-c23a-4f50-bf5e-863c83599d81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:18.253471 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2adb3644-c23a-4f50-bf5e-863c83599d81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:18.253911 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2adb3644-c23a-4f50-bf5e-863c83599d81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:18.254329 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2adb3644-c23a-4f50-bf5e-863c83599d81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:18.468293 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2adb3644-c23a-4f50-bf5e-863c83599d81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:40:18.475909 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2adb3644-c23a-4f50-bf5e-863c83599d81 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 200 len: 1684 microversion: 2.1 time: 0.235315 Oct 06 12:40:18.476477 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 620/1243] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:40:18 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 1684 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:40:19.024299 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-cee69197-e5b5-4fe3-a538-78bbeb6870ce req-aaa00e34-d100-4807-b848-7851f1a3c733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365eefdd-0377-4569-8684-30f8dc19ef9d", "name": "network-vif-deleted", "tag": "e555afd2-d7ca-452f-b30a-cd726c904b32"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:40:19.035224 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-cee69197-e5b5-4fe3-a538-78bbeb6870ce req-aaa00e34-d100-4807-b848-7851f1a3c733 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:19.036077 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-cee69197-e5b5-4fe3-a538-78bbeb6870ce req-aaa00e34-d100-4807-b848-7851f1a3c733 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:19.036646 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-cee69197-e5b5-4fe3-a538-78bbeb6870ce req-aaa00e34-d100-4807-b848-7851f1a3c733 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:19.048309 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-cee69197-e5b5-4fe3-a538-78bbeb6870ce req-aaa00e34-d100-4807-b848-7851f1a3c733 service nova] Creating event network-vif-deleted:e555afd2-d7ca-452f-b30a-cd726c904b32 for instance 365eefdd-0377-4569-8684-30f8dc19ef9d on hv-cinder-85604 Oct 06 12:40:19.053639 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-cee69197-e5b5-4fe3-a538-78bbeb6870ce req-aaa00e34-d100-4807-b848-7851f1a3c733 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033340 Oct 06 12:40:19.054553 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 624/1244] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:40:19.500601 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f70f6893-71d2-4717-98b5-bad884ec7065 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:19.501237 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f70f6893-71d2-4717-98b5-bad884ec7065 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:19.508643 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f70f6893-71d2-4717-98b5-bad884ec7065 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:19.509200 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f70f6893-71d2-4717-98b5-bad884ec7065 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:19.509723 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f70f6893-71d2-4717-98b5-bad884ec7065 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:19.510610 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f70f6893-71d2-4717-98b5-bad884ec7065 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:19.512252 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f70f6893-71d2-4717-98b5-bad884ec7065 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:19.512956 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f70f6893-71d2-4717-98b5-bad884ec7065 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:19.546457 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f70f6893-71d2-4717-98b5-bad884ec7065 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:19.547108 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f70f6893-71d2-4717-98b5-bad884ec7065 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:19.547630 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f70f6893-71d2-4717-98b5-bad884ec7065 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:19.548420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-f70f6893-71d2-4717-98b5-bad884ec7065 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lazy-loading 'fault' on Instance uuid 365eefdd-0377-4569-8684-30f8dc19ef9d {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:40:19.598034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f70f6893-71d2-4717-98b5-bad884ec7065 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404c5e2b85454e1e91b90fa45796511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee9f30f6e1d4d1ab2c4fe269d78d768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:40:19.606381 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f70f6893-71d2-4717-98b5-bad884ec7065 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 200 len: 1332 microversion: 2.1 time: 0.110717 Oct 06 12:40:19.607248 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 621/1245] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:40:19 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 1332 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:40:20.630914 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ed7e84bb-2d7f-4a51-8c24-de3f939d9da3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:20.631656 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-ed7e84bb-2d7f-4a51-8c24-de3f939d9da3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:20.638266 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed7e84bb-2d7f-4a51-8c24-de3f939d9da3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:20.638751 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed7e84bb-2d7f-4a51-8c24-de3f939d9da3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:20.639190 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed7e84bb-2d7f-4a51-8c24-de3f939d9da3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:20.639984 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed7e84bb-2d7f-4a51-8c24-de3f939d9da3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:20.640442 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed7e84bb-2d7f-4a51-8c24-de3f939d9da3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:20.640872 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-ed7e84bb-2d7f-4a51-8c24-de3f939d9da3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:20.654521 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-ed7e84bb-2d7f-4a51-8c24-de3f939d9da3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] HTTP exception thrown: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ed7e84bb-2d7f-4a51-8c24-de3f939d9da3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Request method failure captured: Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d HTTP/1.1 Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPsr0UNK1P5BhO28OBkcDUnSTA6CLARX6kiYEnj9_EsFiFVQzbi9_-NwZXrV3onBT0iZzu53Suft87ihWCMXUkJiHd9VthtJL9JTrWeTj4WwUlwrgkezgw1Mac-Yo3NoEL3SyrVpl_ar1oH1uwMuGD0iuYPnjIr5s5JetZyLhVFw4jdM Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:40:20.656171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:40:20.658075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bee9f30f6e1d4d1ab2c4fe269d78d768", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:40:20.658075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:20.658075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:20.658075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:20.658075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:20.658075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:40:20.658075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:40:20.658075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 404c5e2b85454e1e91b90fa45796511e Oct 06 12:40:20.658075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:20.658075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:40:20.658075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. Oct 06 12:40:20.658075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '365eefdd-0377-4569-8684-30f8dc19ef9d'} Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:40:20.659139 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. Oct 06 12:40:20.661225 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:20.662739 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-ed7e84bb-2d7f-4a51-8c24-de3f939d9da3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Returning 404 to user: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:40:20.662739 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-ed7e84bb-2d7f-4a51-8c24-de3f939d9da3 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 404 len: 111 microversion: 2.1 time: 0.031337 Oct 06 12:40:20.662739 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 625/1246] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:40:20 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:40:20.666716 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-07e88346-4aa1-41d0-9e77-f31011118007 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '.version_select at 0x7f03aaceeaf0>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:20.685022 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-07e88346-4aa1-41d0-9e77-f31011118007 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118256570" status: 202 len: 0 microversion: 2.1 time: 0.022103 Oct 06 12:40:20.685668 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 622/1247] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Oct 6 12:40:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118256570 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:40:22.427938 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0a4d21cc-2dbd-459a-854b-00d96c6bce9e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:22.428432 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-0a4d21cc-2dbd-459a-854b-00d96c6bce9e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:22.435209 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0a4d21cc-2dbd-459a-854b-00d96c6bce9e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:22.435722 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0a4d21cc-2dbd-459a-854b-00d96c6bce9e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:22.436154 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0a4d21cc-2dbd-459a-854b-00d96c6bce9e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:22.436835 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0a4d21cc-2dbd-459a-854b-00d96c6bce9e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:22.437288 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0a4d21cc-2dbd-459a-854b-00d96c6bce9e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:22.437855 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-0a4d21cc-2dbd-459a-854b-00d96c6bce9e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:22.454254 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-0a4d21cc-2dbd-459a-854b-00d96c6bce9e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] HTTP exception thrown: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0a4d21cc-2dbd-459a-854b-00d96c6bce9e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Request method failure captured: Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: DELETE /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d HTTP/1.1 Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPsr0UNK1P5BhO28OBkcDUnSTA6CLARX6kiYEnj9_EsFiFVQzbi9_-NwZXrV3onBT0iZzu53Suft87ihWCMXUkJiHd9VthtJL9JTrWeTj4WwUlwrgkezgw1Mac-Yo3NoEL3SyrVpl_ar1oH1uwMuGD0iuYPnjIr5s5JetZyLhVFw4jdM Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:40:22.455811 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:40:22.457525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bee9f30f6e1d4d1ab2c4fe269d78d768", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:40:22.457525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:22.457525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:22.457525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:22.457525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:22.457525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:40:22.457525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:40:22.457525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 404c5e2b85454e1e91b90fa45796511e Oct 06 12:40:22.457525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:22.457525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:40:22.457525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. Oct 06 12:40:22.457525 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '365eefdd-0377-4569-8684-30f8dc19ef9d'} Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:40:22.458678 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. Oct 06 12:40:22.460351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:22.462063 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-0a4d21cc-2dbd-459a-854b-00d96c6bce9e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Returning 404 to user: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:40:22.462063 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-0a4d21cc-2dbd-459a-854b-00d96c6bce9e tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 404 len: 111 microversion: 2.1 time: 0.033060 Oct 06 12:40:22.462063 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 626/1248] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:40:22 2022] DELETE /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:40:22.466248 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5aeff327-bc61-4a95-9338-a1089c101db1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:22.466888 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5aeff327-bc61-4a95-9338-a1089c101db1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 365eefdd-0377-4569-8684-30f8dc19ef9d] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:22.473411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5aeff327-bc61-4a95-9338-a1089c101db1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:22.473893 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5aeff327-bc61-4a95-9338-a1089c101db1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:22.474322 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5aeff327-bc61-4a95-9338-a1089c101db1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:22.475003 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5aeff327-bc61-4a95-9338-a1089c101db1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:22.475450 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5aeff327-bc61-4a95-9338-a1089c101db1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:22.475923 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5aeff327-bc61-4a95-9338-a1089c101db1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:22.490381 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-5aeff327-bc61-4a95-9338-a1089c101db1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] HTTP exception thrown: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5aeff327-bc61-4a95-9338-a1089c101db1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Request method failure captured: Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d HTTP/1.1 Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsr0UNK1P5BhO28OBkcDUnSTA6CLARX6kiYEnj9_EsFiFVQzbi9_-NwZXrV3onBT0iZzu53Suft87ihWCMXUkJiHd9VthtJL9JTrWeTj4WwUlwrgkezgw1Mac-Yo3NoEL3SyrVpl_ar1oH1uwMuGD0iuYPnjIr5s5JetZyLhVFw4jdM Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:40:22.492024 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:40:22.493720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bee9f30f6e1d4d1ab2c4fe269d78d768", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:40:22.493720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:22.493720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:22.493720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:22.493720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:22.493720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:40:22.493720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:40:22.493720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 404c5e2b85454e1e91b90fa45796511e Oct 06 12:40:22.493720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:22.493720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:40:22.493720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. Oct 06 12:40:22.493720 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '365eefdd-0377-4569-8684-30f8dc19ef9d'} Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:40:22.494598 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. Oct 06 12:40:22.496504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:22.497826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5aeff327-bc61-4a95-9338-a1089c101db1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Returning 404 to user: Instance 365eefdd-0377-4569-8684-30f8dc19ef9d could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:40:22.497826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5aeff327-bc61-4a95-9338-a1089c101db1 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d" status: 404 len: 111 microversion: 2.1 time: 0.031611 Oct 06 12:40:22.497826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 623/1249] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:40:22 2022] GET /compute/v2.1/servers/365eefdd-0377-4569-8684-30f8dc19ef9d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:40:23.630405 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1bafb038-111f-43c3-b52a-aabeecbb6d56 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:23.631092 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-1bafb038-111f-43c3-b52a-aabeecbb6d56 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:23.638452 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1bafb038-111f-43c3-b52a-aabeecbb6d56 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:23.639019 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1bafb038-111f-43c3-b52a-aabeecbb6d56 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:23.639469 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1bafb038-111f-43c3-b52a-aabeecbb6d56 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:23.640203 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1bafb038-111f-43c3-b52a-aabeecbb6d56 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:23.640662 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1bafb038-111f-43c3-b52a-aabeecbb6d56 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:23.641091 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-1bafb038-111f-43c3-b52a-aabeecbb6d56 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:23.655673 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-1bafb038-111f-43c3-b52a-aabeecbb6d56 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] HTTP exception thrown: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1bafb038-111f-43c3-b52a-aabeecbb6d56 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Request method failure captured: Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: DELETE /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 HTTP/1.1 Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPsr0UNK1P5BhO28OBkcDUnSTA6CLARX6kiYEnj9_EsFiFVQzbi9_-NwZXrV3onBT0iZzu53Suft87ihWCMXUkJiHd9VthtJL9JTrWeTj4WwUlwrgkezgw1Mac-Yo3NoEL3SyrVpl_ar1oH1uwMuGD0iuYPnjIr5s5JetZyLhVFw4jdM Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:40:23.657274 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:40:23.659143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bee9f30f6e1d4d1ab2c4fe269d78d768", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:40:23.659143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:23.659143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:23.659143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:23.659143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:23.659143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:40:23.659143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:40:23.659143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 404c5e2b85454e1e91b90fa45796511e Oct 06 12:40:23.659143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:23.659143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:40:23.659143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. Oct 06 12:40:23.659143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9'} Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:40:23.660318 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. Oct 06 12:40:23.665680 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.667409 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-1bafb038-111f-43c3-b52a-aabeecbb6d56 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Returning 404 to user: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:40:23.667409 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-1bafb038-111f-43c3-b52a-aabeecbb6d56 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 404 len: 111 microversion: 2.1 time: 0.032281 Oct 06 12:40:23.667409 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 627/1250] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:40:23 2022] DELETE /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:40:23.667712 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-655f5dff-4560-424e-912b-99f27fd70c60 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:23.668186 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-655f5dff-4560-424e-912b-99f27fd70c60 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:23.674511 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-655f5dff-4560-424e-912b-99f27fd70c60 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:23.674981 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-655f5dff-4560-424e-912b-99f27fd70c60 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:23.675405 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-655f5dff-4560-424e-912b-99f27fd70c60 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:23.677945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-655f5dff-4560-424e-912b-99f27fd70c60 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:23.677945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-655f5dff-4560-424e-912b-99f27fd70c60 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:23.677945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-655f5dff-4560-424e-912b-99f27fd70c60 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:23.690648 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-655f5dff-4560-424e-912b-99f27fd70c60 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] HTTP exception thrown: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-655f5dff-4560-424e-912b-99f27fd70c60 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Request method failure captured: Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 HTTP/1.1 Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsr0UNK1P5BhO28OBkcDUnSTA6CLARX6kiYEnj9_EsFiFVQzbi9_-NwZXrV3onBT0iZzu53Suft87ihWCMXUkJiHd9VthtJL9JTrWeTj4WwUlwrgkezgw1Mac-Yo3NoEL3SyrVpl_ar1oH1uwMuGD0iuYPnjIr5s5JetZyLhVFw4jdM Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:40:23.692198 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:40:23.693938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bee9f30f6e1d4d1ab2c4fe269d78d768", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:40:23.693938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:23.693938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:23.693938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:23.693938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:23.693938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:40:23.693938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:40:23.693938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 404c5e2b85454e1e91b90fa45796511e Oct 06 12:40:23.693938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:23.693938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:40:23.693938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. Oct 06 12:40:23.693938 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9'} Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:40:23.695107 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. Oct 06 12:40:23.699134 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.700655 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-655f5dff-4560-424e-912b-99f27fd70c60 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Returning 404 to user: Instance 4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:40:23.700655 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-655f5dff-4560-424e-912b-99f27fd70c60 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9" status: 404 len: 111 microversion: 2.1 time: 0.030026 Oct 06 12:40:23.700655 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 624/1251] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:40:23 2022] GET /compute/v2.1/servers/4d9b7e98-d1b6-4d50-9eef-bfd7e5d9a4c9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:40:23.703015 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d6c394fd-2714-4f0a-b85f-89156cd6092d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:23.703574 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d6c394fd-2714-4f0a-b85f-89156cd6092d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:23.709585 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6c394fd-2714-4f0a-b85f-89156cd6092d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:23.710072 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6c394fd-2714-4f0a-b85f-89156cd6092d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:23.710503 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6c394fd-2714-4f0a-b85f-89156cd6092d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:23.711221 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6c394fd-2714-4f0a-b85f-89156cd6092d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:23.711780 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6c394fd-2714-4f0a-b85f-89156cd6092d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:23.712217 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d6c394fd-2714-4f0a-b85f-89156cd6092d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:23.726195 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-d6c394fd-2714-4f0a-b85f-89156cd6092d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] HTTP exception thrown: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d6c394fd-2714-4f0a-b85f-89156cd6092d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Request method failure captured: Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: DELETE /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 HTTP/1.1 Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPsr0UNK1P5BhO28OBkcDUnSTA6CLARX6kiYEnj9_EsFiFVQzbi9_-NwZXrV3onBT0iZzu53Suft87ihWCMXUkJiHd9VthtJL9JTrWeTj4WwUlwrgkezgw1Mac-Yo3NoEL3SyrVpl_ar1oH1uwMuGD0iuYPnjIr5s5JetZyLhVFw4jdM Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:40:23.727859 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:40:23.729599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bee9f30f6e1d4d1ab2c4fe269d78d768", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:40:23.729599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:23.729599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:23.729599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:23.729599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:23.729599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:40:23.729599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:40:23.729599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 404c5e2b85454e1e91b90fa45796511e Oct 06 12:40:23.729599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:23.729599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:40:23.729599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. Oct 06 12:40:23.729599 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '9aae47f4-74e0-47ee-8859-407ff1e7a221'} Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:40:23.730460 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. Oct 06 12:40:23.731825 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.733171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d6c394fd-2714-4f0a-b85f-89156cd6092d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Returning 404 to user: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:40:23.733171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d6c394fd-2714-4f0a-b85f-89156cd6092d tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 404 len: 111 microversion: 2.1 time: 0.030828 Oct 06 12:40:23.733171 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 628/1252] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:40:23 2022] DELETE /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:40:23.737909 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-400f1de0-b30a-4375-8a30-3a4ac2559128 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:23.738518 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-400f1de0-b30a-4375-8a30-3a4ac2559128 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 9aae47f4-74e0-47ee-8859-407ff1e7a221] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:23.744865 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-400f1de0-b30a-4375-8a30-3a4ac2559128 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:23.745348 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-400f1de0-b30a-4375-8a30-3a4ac2559128 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:23.745788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-400f1de0-b30a-4375-8a30-3a4ac2559128 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:23.746477 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-400f1de0-b30a-4375-8a30-3a4ac2559128 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:23.746932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-400f1de0-b30a-4375-8a30-3a4ac2559128 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:23.747359 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-400f1de0-b30a-4375-8a30-3a4ac2559128 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:23.760682 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-400f1de0-b30a-4375-8a30-3a4ac2559128 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] HTTP exception thrown: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-400f1de0-b30a-4375-8a30-3a4ac2559128 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Request method failure captured: Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 HTTP/1.1 Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsr0UNK1P5BhO28OBkcDUnSTA6CLARX6kiYEnj9_EsFiFVQzbi9_-NwZXrV3onBT0iZzu53Suft87ihWCMXUkJiHd9VthtJL9JTrWeTj4WwUlwrgkezgw1Mac-Yo3NoEL3SyrVpl_ar1oH1uwMuGD0iuYPnjIr5s5JetZyLhVFw4jdM Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:40:23.762750 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:40:23.764542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bee9f30f6e1d4d1ab2c4fe269d78d768", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:40:23.764542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:23.764542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:23.764542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:23.764542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:23.764542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:40:23.764542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:40:23.764542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 404c5e2b85454e1e91b90fa45796511e Oct 06 12:40:23.764542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:23.764542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:40:23.764542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. Oct 06 12:40:23.764542 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '9aae47f4-74e0-47ee-8859-407ff1e7a221'} Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:40:23.765499 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. Oct 06 12:40:23.768286 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:23.769920 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-400f1de0-b30a-4375-8a30-3a4ac2559128 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Returning 404 to user: Instance 9aae47f4-74e0-47ee-8859-407ff1e7a221 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:40:23.769920 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-400f1de0-b30a-4375-8a30-3a4ac2559128 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221" status: 404 len: 111 microversion: 2.1 time: 0.030705 Oct 06 12:40:23.769920 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 625/1253] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:40:23 2022] GET /compute/v2.1/servers/9aae47f4-74e0-47ee-8859-407ff1e7a221 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:40:24.906488 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-00d33f0b-00b0-471d-adf5-15b8785df970 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:24.907068 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-00d33f0b-00b0-471d-adf5-15b8785df970 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:24.913679 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-00d33f0b-00b0-471d-adf5-15b8785df970 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:24.914155 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-00d33f0b-00b0-471d-adf5-15b8785df970 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:24.914583 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-00d33f0b-00b0-471d-adf5-15b8785df970 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:24.915257 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-00d33f0b-00b0-471d-adf5-15b8785df970 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:24.915742 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-00d33f0b-00b0-471d-adf5-15b8785df970 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:24.916166 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-00d33f0b-00b0-471d-adf5-15b8785df970 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:24.930026 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-00d33f0b-00b0-471d-adf5-15b8785df970 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] HTTP exception thrown: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-00d33f0b-00b0-471d-adf5-15b8785df970 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Request method failure captured: Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: DELETE /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 HTTP/1.1 Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPsr0UNK1P5BhO28OBkcDUnSTA6CLARX6kiYEnj9_EsFiFVQzbi9_-NwZXrV3onBT0iZzu53Suft87ihWCMXUkJiHd9VthtJL9JTrWeTj4WwUlwrgkezgw1Mac-Yo3NoEL3SyrVpl_ar1oH1uwMuGD0iuYPnjIr5s5JetZyLhVFw4jdM Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:40:24.931702 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:40:24.933416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bee9f30f6e1d4d1ab2c4fe269d78d768", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:40:24.933416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:24.933416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:24.933416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:24.933416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:24.933416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:40:24.933416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:40:24.933416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: 404c5e2b85454e1e91b90fa45796511e Oct 06 12:40:24.933416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:24.933416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:40:24.933416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. Oct 06 12:40:24.933416 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '82453bcd-3cd1-4cdc-b79a-88a352314608'} Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:40:24.934403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. Oct 06 12:40:24.936061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:40:24.938017 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-00d33f0b-00b0-471d-adf5-15b8785df970 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Returning 404 to user: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:40:24.938017 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-00d33f0b-00b0-471d-adf5-15b8785df970 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 404 len: 111 microversion: 2.1 time: 0.030430 Oct 06 12:40:24.938017 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 629/1254] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:40:24 2022] DELETE /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:40:24.941657 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-da06b467-8bf8-4619-a8a2-4fb8d4a1c2c6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:24.942266 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-da06b467-8bf8-4619-a8a2-4fb8d4a1c2c6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] [instance: 82453bcd-3cd1-4cdc-b79a-88a352314608] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:24.948295 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da06b467-8bf8-4619-a8a2-4fb8d4a1c2c6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:24.948777 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da06b467-8bf8-4619-a8a2-4fb8d4a1c2c6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:24.949704 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da06b467-8bf8-4619-a8a2-4fb8d4a1c2c6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:24.950405 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da06b467-8bf8-4619-a8a2-4fb8d4a1c2c6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:24.950853 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da06b467-8bf8-4619-a8a2-4fb8d4a1c2c6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:24.951273 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-da06b467-8bf8-4619-a8a2-4fb8d4a1c2c6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:24.964656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-da06b467-8bf8-4619-a8a2-4fb8d4a1c2c6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] HTTP exception thrown: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-da06b467-8bf8-4619-a8a2-4fb8d4a1c2c6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Request method failure captured: Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 HTTP/1.1 Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPsr0UNK1P5BhO28OBkcDUnSTA6CLARX6kiYEnj9_EsFiFVQzbi9_-NwZXrV3onBT0iZzu53Suft87ihWCMXUkJiHd9VthtJL9JTrWeTj4WwUlwrgkezgw1Mac-Yo3NoEL3SyrVpl_ar1oH1uwMuGD0iuYPnjIr5s5JetZyLhVFw4jdM Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:40:24.966845 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:40:24.968617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bee9f30f6e1d4d1ab2c4fe269d78d768", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bee9f30f6e1d4d1ab2c4fe269d78d768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:40:24.968617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:24.968617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: bee9f30f6e1d4d1ab2c4fe269d78d768 Oct 06 12:40:24.968617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565518581 Oct 06 12:40:24.968617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:24.968617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:40:24.968617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:40:24.968617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 404c5e2b85454e1e91b90fa45796511e Oct 06 12:40:24.968617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-AttachVolumeNegativeTest-1565518581-project Oct 06 12:40:24.968617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:40:24.968617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. Oct 06 12:40:24.968617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': '82453bcd-3cd1-4cdc-b79a-88a352314608'} Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:40:24.969633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. Oct 06 12:40:24.971320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:40:24.972825 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-da06b467-8bf8-4619-a8a2-4fb8d4a1c2c6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] Returning 404 to user: Instance 82453bcd-3cd1-4cdc-b79a-88a352314608 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:40:24.972825 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-da06b467-8bf8-4619-a8a2-4fb8d4a1c2c6 tempest-AttachVolumeNegativeTest-1565518581 tempest-AttachVolumeNegativeTest-1565518581-project] 10.222.0.33 "GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608" status: 404 len: 111 microversion: 2.1 time: 0.030616 Oct 06 12:40:24.972825 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 626/1255] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:40:24 2022] GET /compute/v2.1/servers/82453bcd-3cd1-4cdc-b79a-88a352314608 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:40:56.898393 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-393559975", "imageRef": "174b0591-4f78-42f1-afd5-3c5d23629ece", "flavorRef": "452"}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:40:56.906067 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:40:56.906718 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:40:56.954422 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.network.neutron [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] validate_networks() for None {{(pid=120508) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:40:57.220342 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Flavor limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:40:57.220772 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Image limits 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:40:57.221248 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Flavor pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:40:57.221660 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Image pref 0:0:0 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:40:57.222102 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.virt.hardware [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:40:57.230701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:57.231189 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:57.231666 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:57.232396 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:57.232856 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:57.233285 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:57.250183 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Getting quotas for project 352ca3049c444444a8ce0c29170dd517. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:40:57.254207 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Getting quotas for user 5c9dbce0a6f9482397a79cd734ebab07 and project 352ca3049c444444a8ce0c29170dd517. Resources: {'cores', 'instances', 'ram'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:40:57.265337 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Going to run 1 instances... {{(pid=120508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:40:57.267635 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='174b0591-4f78-42f1-afd5-3c5d23629ece',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:40:57.309874 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR oslo.messaging._drivers.impl_rabbit [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [201d1db6-e0a1-4009-b6ca-ec83b012d2a5] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 12:40:58.317362 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO oslo.messaging._drivers.impl_rabbit [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [201d1db6-e0a1-4009-b6ca-ec83b012d2a5] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 46012. Oct 06 12:40:58.321541 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-086ca0c6-659a-4f5e-bf89-27e656efd809 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.427224 Oct 06 12:40:58.322184 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 630/1256] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:40:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:40:58.333381 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2a47e4fd-67bd-4c65-aaec-dda74f7655c9 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:58.333984 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2a47e4fd-67bd-4c65-aaec-dda74f7655c9 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:58.336140 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:40:58.336788 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:40:58.389791 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2a47e4fd-67bd-4c65-aaec-dda74f7655c9 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9dbce0a6f9482397a79cd734ebab07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352ca3049c444444a8ce0c29170dd517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:40:58.396754 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2a47e4fd-67bd-4c65-aaec-dda74f7655c9 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 200 len: 1214 microversion: 2.1 time: 0.067439 Oct 06 12:40:58.397395 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 627/1257] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:40:58 2022] GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:40:59.421150 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-18dbc9d8-2e65-419d-bd46-0cbe0048a1d6 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:59.421766 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-18dbc9d8-2e65-419d-bd46-0cbe0048a1d6 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:40:59.428402 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18dbc9d8-2e65-419d-bd46-0cbe0048a1d6 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:59.428883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18dbc9d8-2e65-419d-bd46-0cbe0048a1d6 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:59.429319 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18dbc9d8-2e65-419d-bd46-0cbe0048a1d6 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:59.430005 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18dbc9d8-2e65-419d-bd46-0cbe0048a1d6 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:40:59.430459 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18dbc9d8-2e65-419d-bd46-0cbe0048a1d6 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:40:59.430884 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-18dbc9d8-2e65-419d-bd46-0cbe0048a1d6 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:40:59.497326 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-18dbc9d8-2e65-419d-bd46-0cbe0048a1d6 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9dbce0a6f9482397a79cd734ebab07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352ca3049c444444a8ce0c29170dd517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:40:59.505504 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-18dbc9d8-2e65-419d-bd46-0cbe0048a1d6 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 200 len: 1266 microversion: 2.1 time: 0.089197 Oct 06 12:40:59.506078 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 631/1258] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:40:59 2022] GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:00.529090 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2b8d2e5a-12eb-44bc-b2b2-0e86e177bf5f tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:00.529717 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2b8d2e5a-12eb-44bc-b2b2-0e86e177bf5f tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:00.536208 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b8d2e5a-12eb-44bc-b2b2-0e86e177bf5f tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:00.536725 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b8d2e5a-12eb-44bc-b2b2-0e86e177bf5f tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:00.537287 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b8d2e5a-12eb-44bc-b2b2-0e86e177bf5f tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:00.537983 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b8d2e5a-12eb-44bc-b2b2-0e86e177bf5f tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:00.538433 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b8d2e5a-12eb-44bc-b2b2-0e86e177bf5f tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:00.538856 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2b8d2e5a-12eb-44bc-b2b2-0e86e177bf5f tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:00.733133 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2b8d2e5a-12eb-44bc-b2b2-0e86e177bf5f tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9dbce0a6f9482397a79cd734ebab07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352ca3049c444444a8ce0c29170dd517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:00.743054 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2b8d2e5a-12eb-44bc-b2b2-0e86e177bf5f tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 200 len: 1314 microversion: 2.1 time: 0.218091 Oct 06 12:41:00.743947 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 628/1259] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:00 2022] GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:01.528420 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-cf05f90f-f037-4322-9439-71bc9050bdb6 req-1475d697-6b37-40d4-8de2-7984c6514904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2156e95-a74d-4b3c-bef8-e7ef06183d42", "tag": "525a6298-cac8-45ff-8a9f-64e610c1f7df"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:41:01.538153 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-cf05f90f-f037-4322-9439-71bc9050bdb6 req-1475d697-6b37-40d4-8de2-7984c6514904 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:01.538644 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-cf05f90f-f037-4322-9439-71bc9050bdb6 req-1475d697-6b37-40d4-8de2-7984c6514904 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:01.539077 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-cf05f90f-f037-4322-9439-71bc9050bdb6 req-1475d697-6b37-40d4-8de2-7984c6514904 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:01.550551 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-cf05f90f-f037-4322-9439-71bc9050bdb6 req-1475d697-6b37-40d4-8de2-7984c6514904 service nova] Creating event network-changed:525a6298-cac8-45ff-8a9f-64e610c1f7df for instance b2156e95-a74d-4b3c-bef8-e7ef06183d42 on hv-cinder-85604 Oct 06 12:41:01.555239 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-cf05f90f-f037-4322-9439-71bc9050bdb6 req-1475d697-6b37-40d4-8de2-7984c6514904 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183191 Oct 06 12:41:01.555870 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 632/1260] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:41:01.767730 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-a36a9833-26a1-42be-a207-17f19aae1eb2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:01.768434 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-a36a9833-26a1-42be-a207-17f19aae1eb2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:01.774504 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a36a9833-26a1-42be-a207-17f19aae1eb2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:01.774992 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a36a9833-26a1-42be-a207-17f19aae1eb2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:01.775438 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a36a9833-26a1-42be-a207-17f19aae1eb2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:01.776158 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a36a9833-26a1-42be-a207-17f19aae1eb2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:01.776614 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a36a9833-26a1-42be-a207-17f19aae1eb2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:01.777656 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-a36a9833-26a1-42be-a207-17f19aae1eb2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:01.909297 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-a36a9833-26a1-42be-a207-17f19aae1eb2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9dbce0a6f9482397a79cd734ebab07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352ca3049c444444a8ce0c29170dd517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:01.917140 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-a36a9833-26a1-42be-a207-17f19aae1eb2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 200 len: 1314 microversion: 2.1 time: 0.153346 Oct 06 12:41:01.918205 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 629/1261] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:01 2022] GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:02.941402 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-83eff915-91ef-4b06-b340-64d7eb323a6c tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:02.942160 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-83eff915-91ef-4b06-b340-64d7eb323a6c tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:02.948215 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-83eff915-91ef-4b06-b340-64d7eb323a6c tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:02.948701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-83eff915-91ef-4b06-b340-64d7eb323a6c tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:02.949143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-83eff915-91ef-4b06-b340-64d7eb323a6c tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:02.949833 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-83eff915-91ef-4b06-b340-64d7eb323a6c tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:02.950290 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-83eff915-91ef-4b06-b340-64d7eb323a6c tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:02.950863 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-83eff915-91ef-4b06-b340-64d7eb323a6c tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:03.081613 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-83eff915-91ef-4b06-b340-64d7eb323a6c tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9dbce0a6f9482397a79cd734ebab07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352ca3049c444444a8ce0c29170dd517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:03.089208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-83eff915-91ef-4b06-b340-64d7eb323a6c tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 200 len: 1314 microversion: 2.1 time: 0.152538 Oct 06 12:41:03.090311 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 633/1262] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:02 2022] GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:41:04.112321 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-6fcd2dc7-d396-44b7-a54c-c7ae320a1709 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:04.112933 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-6fcd2dc7-d396-44b7-a54c-c7ae320a1709 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:04.119284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fcd2dc7-d396-44b7-a54c-c7ae320a1709 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:04.119815 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fcd2dc7-d396-44b7-a54c-c7ae320a1709 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:04.120242 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fcd2dc7-d396-44b7-a54c-c7ae320a1709 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:04.121524 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fcd2dc7-d396-44b7-a54c-c7ae320a1709 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:04.121954 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fcd2dc7-d396-44b7-a54c-c7ae320a1709 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:04.122498 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6fcd2dc7-d396-44b7-a54c-c7ae320a1709 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:04.296846 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-6fcd2dc7-d396-44b7-a54c-c7ae320a1709 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9dbce0a6f9482397a79cd734ebab07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352ca3049c444444a8ce0c29170dd517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:04.304435 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-6fcd2dc7-d396-44b7-a54c-c7ae320a1709 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 200 len: 1314 microversion: 2.1 time: 0.196080 Oct 06 12:41:04.304996 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 630/1263] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:04 2022] GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:05.326141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-28a3dd1d-433f-4667-837b-09b2a81211be tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:05.326761 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-28a3dd1d-433f-4667-837b-09b2a81211be tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:05.333242 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28a3dd1d-433f-4667-837b-09b2a81211be tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:05.333724 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28a3dd1d-433f-4667-837b-09b2a81211be tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:05.334160 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28a3dd1d-433f-4667-837b-09b2a81211be tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:05.334849 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28a3dd1d-433f-4667-837b-09b2a81211be tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:05.335305 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28a3dd1d-433f-4667-837b-09b2a81211be tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:05.335760 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-28a3dd1d-433f-4667-837b-09b2a81211be tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:05.462623 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-28a3dd1d-433f-4667-837b-09b2a81211be tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9dbce0a6f9482397a79cd734ebab07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352ca3049c444444a8ce0c29170dd517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:05.470234 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-28a3dd1d-433f-4667-837b-09b2a81211be tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 200 len: 1314 microversion: 2.1 time: 0.147998 Oct 06 12:41:05.470800 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 634/1264] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:05 2022] GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:06.493626 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-2234b9d3-0f44-463d-8e87-3691df1bb844 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:06.494227 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-2234b9d3-0f44-463d-8e87-3691df1bb844 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:06.501325 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2234b9d3-0f44-463d-8e87-3691df1bb844 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:06.501749 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2234b9d3-0f44-463d-8e87-3691df1bb844 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:06.502184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2234b9d3-0f44-463d-8e87-3691df1bb844 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:06.502865 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2234b9d3-0f44-463d-8e87-3691df1bb844 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:06.503335 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2234b9d3-0f44-463d-8e87-3691df1bb844 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:06.503769 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-2234b9d3-0f44-463d-8e87-3691df1bb844 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:06.631657 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-2234b9d3-0f44-463d-8e87-3691df1bb844 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9dbce0a6f9482397a79cd734ebab07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352ca3049c444444a8ce0c29170dd517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:06.639267 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-2234b9d3-0f44-463d-8e87-3691df1bb844 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 200 len: 1314 microversion: 2.1 time: 0.149526 Oct 06 12:41:06.639862 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 631/1265] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:06 2022] GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:07.079780 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-d4909719-d12e-4fc4-ba20-57565fd7733c req-6c93a756-a9e7-4578-b562-8bc3b8d9911f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2156e95-a74d-4b3c-bef8-e7ef06183d42", "name": "network-vif-plugged", "status": "completed", "tag": "525a6298-cac8-45ff-8a9f-64e610c1f7df"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:41:07.090487 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-d4909719-d12e-4fc4-ba20-57565fd7733c req-6c93a756-a9e7-4578-b562-8bc3b8d9911f service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:07.090976 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-d4909719-d12e-4fc4-ba20-57565fd7733c req-6c93a756-a9e7-4578-b562-8bc3b8d9911f service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:07.091403 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-d4909719-d12e-4fc4-ba20-57565fd7733c req-6c93a756-a9e7-4578-b562-8bc3b8d9911f service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:07.103911 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-d4909719-d12e-4fc4-ba20-57565fd7733c req-6c93a756-a9e7-4578-b562-8bc3b8d9911f service nova] Creating event network-vif-plugged:525a6298-cac8-45ff-8a9f-64e610c1f7df for instance b2156e95-a74d-4b3c-bef8-e7ef06183d42 on hv-cinder-85604 Oct 06 12:41:07.109341 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-d4909719-d12e-4fc4-ba20-57565fd7733c req-6c93a756-a9e7-4578-b562-8bc3b8d9911f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033306 Oct 06 12:41:07.110276 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 635/1266] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:41:07.662067 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-343922fe-9edc-4573-aa98-a98e4d38c316 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:07.662615 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-343922fe-9edc-4573-aa98-a98e4d38c316 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:07.668945 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-343922fe-9edc-4573-aa98-a98e4d38c316 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:07.669420 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-343922fe-9edc-4573-aa98-a98e4d38c316 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:07.669846 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-343922fe-9edc-4573-aa98-a98e4d38c316 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:07.670519 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-343922fe-9edc-4573-aa98-a98e4d38c316 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:07.670962 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-343922fe-9edc-4573-aa98-a98e4d38c316 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:07.671382 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-343922fe-9edc-4573-aa98-a98e4d38c316 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:07.799474 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-343922fe-9edc-4573-aa98-a98e4d38c316 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9dbce0a6f9482397a79cd734ebab07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352ca3049c444444a8ce0c29170dd517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:07.806983 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-343922fe-9edc-4573-aa98-a98e4d38c316 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 200 len: 1314 microversion: 2.1 time: 0.149124 Oct 06 12:41:07.807560 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 632/1267] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:07 2022] GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:08.826193 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:41:08.826985 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=6 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:41:08.831493 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-57c63000-9545-4718-9e05-6a005db4c83d tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:08.832335 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-57c63000-9545-4718-9e05-6a005db4c83d tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:08.839151 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-57c63000-9545-4718-9e05-6a005db4c83d tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:08.840168 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-57c63000-9545-4718-9e05-6a005db4c83d tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:08.840622 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-57c63000-9545-4718-9e05-6a005db4c83d tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:08.841305 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-57c63000-9545-4718-9e05-6a005db4c83d tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:08.841758 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-57c63000-9545-4718-9e05-6a005db4c83d tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:08.842207 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-57c63000-9545-4718-9e05-6a005db4c83d tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:08.967243 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-57c63000-9545-4718-9e05-6a005db4c83d tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9dbce0a6f9482397a79cd734ebab07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352ca3049c444444a8ce0c29170dd517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:08.974802 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-57c63000-9545-4718-9e05-6a005db4c83d tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 200 len: 1314 microversion: 2.1 time: 0.149526 Oct 06 12:41:08.975408 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 636/1268] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:08 2022] GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:09.998124 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-eff3348d-99c7-464a-9f78-d6f014bb51e2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:09.998709 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-eff3348d-99c7-464a-9f78-d6f014bb51e2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:10.000591 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:41:10.006110 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-eff3348d-99c7-464a-9f78-d6f014bb51e2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:10.006587 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-eff3348d-99c7-464a-9f78-d6f014bb51e2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:10.007014 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-eff3348d-99c7-464a-9f78-d6f014bb51e2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:10.007781 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-eff3348d-99c7-464a-9f78-d6f014bb51e2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:10.008174 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-eff3348d-99c7-464a-9f78-d6f014bb51e2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:10.008590 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-eff3348d-99c7-464a-9f78-d6f014bb51e2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:10.139855 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-eff3348d-99c7-464a-9f78-d6f014bb51e2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9dbce0a6f9482397a79cd734ebab07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352ca3049c444444a8ce0c29170dd517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:10.147514 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-eff3348d-99c7-464a-9f78-d6f014bb51e2 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 200 len: 1464 microversion: 2.1 time: 0.153851 Oct 06 12:41:10.148091 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 633/1269] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:09 2022] GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:10.194322 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9ebc561c-3f86-4bc1-9c5d-bb0116daa301 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:10.194826 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9ebc561c-3f86-4bc1-9c5d-bb0116daa301 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:10.201381 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ebc561c-3f86-4bc1-9c5d-bb0116daa301 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:10.201879 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ebc561c-3f86-4bc1-9c5d-bb0116daa301 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:10.202325 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ebc561c-3f86-4bc1-9c5d-bb0116daa301 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:10.203026 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ebc561c-3f86-4bc1-9c5d-bb0116daa301 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:10.203491 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ebc561c-3f86-4bc1-9c5d-bb0116daa301 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:10.203955 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ebc561c-3f86-4bc1-9c5d-bb0116daa301 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:10.228181 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9ebc561c-3f86-4bc1-9c5d-bb0116daa301 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Going to try to terminate instance {{(pid=120508) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:41:10.303645 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9ebc561c-3f86-4bc1-9c5d-bb0116daa301 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 204 len: 0 microversion: 2.1 time: 0.112701 Oct 06 12:41:10.304176 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 637/1270] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:41:10 2022] DELETE /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:41:10.312589 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-cddf9cb1-0bd0-468d-a30b-877ac56acef7 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:10.313190 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-cddf9cb1-0bd0-468d-a30b-877ac56acef7 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:10.318985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cddf9cb1-0bd0-468d-a30b-877ac56acef7 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:10.319460 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cddf9cb1-0bd0-468d-a30b-877ac56acef7 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:10.319917 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cddf9cb1-0bd0-468d-a30b-877ac56acef7 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:10.320590 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cddf9cb1-0bd0-468d-a30b-877ac56acef7 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:10.321034 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cddf9cb1-0bd0-468d-a30b-877ac56acef7 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:10.321449 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-cddf9cb1-0bd0-468d-a30b-877ac56acef7 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:10.444954 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-cddf9cb1-0bd0-468d-a30b-877ac56acef7 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9dbce0a6f9482397a79cd734ebab07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352ca3049c444444a8ce0c29170dd517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:10.452639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-cddf9cb1-0bd0-468d-a30b-877ac56acef7 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 200 len: 1470 microversion: 2.1 time: 0.143938 Oct 06 12:41:10.453197 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 634/1271] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:10 2022] GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 1470 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:11.476471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-63d15a0f-8cf7-4802-9a48-aae91801d102 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:11.477177 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-63d15a0f-8cf7-4802-9a48-aae91801d102 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:11.483560 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63d15a0f-8cf7-4802-9a48-aae91801d102 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:11.484053 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63d15a0f-8cf7-4802-9a48-aae91801d102 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:11.484494 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63d15a0f-8cf7-4802-9a48-aae91801d102 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:11.485186 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63d15a0f-8cf7-4802-9a48-aae91801d102 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:11.485648 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63d15a0f-8cf7-4802-9a48-aae91801d102 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:11.486077 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-63d15a0f-8cf7-4802-9a48-aae91801d102 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:11.614698 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-63d15a0f-8cf7-4802-9a48-aae91801d102 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9dbce0a6f9482397a79cd734ebab07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352ca3049c444444a8ce0c29170dd517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:11.622335 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-63d15a0f-8cf7-4802-9a48-aae91801d102 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 200 len: 1470 microversion: 2.1 time: 0.150085 Oct 06 12:41:11.622905 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 638/1272] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:11 2022] GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:12.425345 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-06b34f62-7e04-49b1-a7bd-bc00e9350682 req-7bb4f279-8bec-4186-a441-dca6b78168a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2156e95-a74d-4b3c-bef8-e7ef06183d42", "name": "network-vif-deleted", "tag": "525a6298-cac8-45ff-8a9f-64e610c1f7df"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:41:12.438543 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-06b34f62-7e04-49b1-a7bd-bc00e9350682 req-7bb4f279-8bec-4186-a441-dca6b78168a5 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:12.439029 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-06b34f62-7e04-49b1-a7bd-bc00e9350682 req-7bb4f279-8bec-4186-a441-dca6b78168a5 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:12.439478 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-06b34f62-7e04-49b1-a7bd-bc00e9350682 req-7bb4f279-8bec-4186-a441-dca6b78168a5 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:12.454954 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-06b34f62-7e04-49b1-a7bd-bc00e9350682 req-7bb4f279-8bec-4186-a441-dca6b78168a5 service nova] Creating event network-vif-deleted:525a6298-cac8-45ff-8a9f-64e610c1f7df for instance b2156e95-a74d-4b3c-bef8-e7ef06183d42 on hv-cinder-85604 Oct 06 12:41:12.464085 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-06b34f62-7e04-49b1-a7bd-bc00e9350682 req-7bb4f279-8bec-4186-a441-dca6b78168a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042437 Oct 06 12:41:12.464712 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 635/1273] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:41:12.645737 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3827b552-6be8-42a0-96e6-1e96ed96ebf1 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:12.646369 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3827b552-6be8-42a0-96e6-1e96ed96ebf1 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:12.652580 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3827b552-6be8-42a0-96e6-1e96ed96ebf1 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:12.653580 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3827b552-6be8-42a0-96e6-1e96ed96ebf1 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:12.654014 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3827b552-6be8-42a0-96e6-1e96ed96ebf1 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:12.654701 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3827b552-6be8-42a0-96e6-1e96ed96ebf1 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:12.655157 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3827b552-6be8-42a0-96e6-1e96ed96ebf1 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:12.655612 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3827b552-6be8-42a0-96e6-1e96ed96ebf1 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:12.685875 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3827b552-6be8-42a0-96e6-1e96ed96ebf1 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:12.686352 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3827b552-6be8-42a0-96e6-1e96ed96ebf1 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:12.686790 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3827b552-6be8-42a0-96e6-1e96ed96ebf1 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:12.687232 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.objects.instance [None req-3827b552-6be8-42a0-96e6-1e96ed96ebf1 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lazy-loading 'fault' on Instance uuid b2156e95-a74d-4b3c-bef8-e7ef06183d42 {{(pid=120508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:41:12.726795 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-3827b552-6be8-42a0-96e6-1e96ed96ebf1 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9dbce0a6f9482397a79cd734ebab07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352ca3049c444444a8ce0c29170dd517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:12.734963 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3827b552-6be8-42a0-96e6-1e96ed96ebf1 tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 200 len: 1304 microversion: 2.1 time: 0.093130 Oct 06 12:41:12.735548 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 639/1274] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:12 2022] GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:13.758892 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-506c109a-43d0-4406-a5bf-c962f3d36dae tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:13.759653 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-506c109a-43d0-4406-a5bf-c962f3d36dae tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] [instance: b2156e95-a74d-4b3c-bef8-e7ef06183d42] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:13.765848 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-506c109a-43d0-4406-a5bf-c962f3d36dae tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:13.766331 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-506c109a-43d0-4406-a5bf-c962f3d36dae tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:13.766770 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-506c109a-43d0-4406-a5bf-c962f3d36dae tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:13.767453 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-506c109a-43d0-4406-a5bf-c962f3d36dae tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:13.767936 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-506c109a-43d0-4406-a5bf-c962f3d36dae tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:13.768365 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-506c109a-43d0-4406-a5bf-c962f3d36dae tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:13.781444 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.wsgi [None req-506c109a-43d0-4406-a5bf-c962f3d36dae tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] HTTP exception thrown: Instance b2156e95-a74d-4b3c-bef8-e7ef06183d42 could not be found. Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-506c109a-43d0-4406-a5bf-c962f3d36dae tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Request method failure captured: Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: request: GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 HTTP/1.1 Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept: application/json Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Accept-Encoding: identity Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Connection: close Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Length: 0 Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Content-Type: application/json Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Host: 10.222.0.33 Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Openstack-System-Scope: None Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: User-Agent: python-urllib3/1.26.12 Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Auth-Token: gAAAAABjPszX-dbXFFegfESjaAhQlOTjhYezG_eiLwYjSYA4MackUBkdULou0iwzic8ufRwZMy_Vf599w8ID508qlYkF4UatXLlKe0kI-JvRjhAZP7yu-aJ0ifhsG23_Boy_Wf5XqDMO5Rv9F8WjUj14tLZ2Tg4TO08gVjU_bGnYm0-MGB_7bPw Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Id: None Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Domain-Name: None Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Identity-Status: Confirmed Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Is-Admin-Project: True Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Id: default Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Domain-Name: Default Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Id: 352ca3049c444444a8ce0c29170dd517 Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Project-Name: tempest-VolumesNegativeTest-1570140297 Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Role: member,reader Oct 06 12:41:13.783082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Roles: member,reader Oct 06 12:41:13.784932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/352ca3049c444444a8ce0c29170dd517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_352ca3049c444444a8ce0c29170dd517", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/352ca3049c444444a8ce0c29170dd517"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/352ca3049c444444a8ce0c29170dd517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:41:13.784932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant: tempest-VolumesNegativeTest-1570140297 Oct 06 12:41:13.784932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Id: 352ca3049c444444a8ce0c29170dd517 Oct 06 12:41:13.784932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-Tenant-Name: tempest-VolumesNegativeTest-1570140297 Oct 06 12:41:13.784932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User: tempest-VolumesNegativeTest-1570140297-project Oct 06 12:41:13.784932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Id: default Oct 06 12:41:13.784932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Domain-Name: Default Oct 06 12:41:13.784932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Id: 5c9dbce0a6f9482397a79cd734ebab07 Oct 06 12:41:13.784932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: X-User-Name: tempest-VolumesNegativeTest-1570140297-project Oct 06 12:41:13.784932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: method: > Oct 06 12:41:13.784932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: exception: Instance b2156e95-a74d-4b3c-bef8-e7ef06183d42 could not be found. Oct 06 12:41:13.784932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: action_args: {'id': 'b2156e95-a74d-4b3c-bef8-e7ef06183d42'} Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2156e95-a74d-4b3c-bef8-e7ef06183d42 could not be found. Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:41:13.786284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2156e95-a74d-4b3c-bef8-e7ef06183d42 could not be found. Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2156e95-a74d-4b3c-bef8-e7ef06183d42 could not be found. Oct 06 12:41:13.788162 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: ERROR nova.api.openstack.wsgi Oct 06 12:41:13.789719 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-506c109a-43d0-4406-a5bf-c962f3d36dae tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] Returning 404 to user: Instance b2156e95-a74d-4b3c-bef8-e7ef06183d42 could not be found. {{(pid=120509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:41:13.789719 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-506c109a-43d0-4406-a5bf-c962f3d36dae tempest-VolumesNegativeTest-1570140297 tempest-VolumesNegativeTest-1570140297-project] 10.222.0.33 "GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42" status: 404 len: 111 microversion: 2.1 time: 0.030349 Oct 06 12:41:13.789719 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 636/1275] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:13 2022] GET /compute/v2.1/servers/b2156e95-a74d-4b3c-bef8-e7ef06183d42 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:41:27.790647 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:41:27.793516 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:41:27.983068 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3bab40d9-5727-4f06-ba78-5e222d59f618 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Action: 'create', calling method: .version_select at 0x7f03aac50c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1256939671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3LOWPqkcRx9q9Dru/TagLUTGzUihAMJO/ZlJt9vP5usDqnHG7Wbee1mCakWu6p7zb9w/f4hqrf6Jzp62PyALs2QHQways7IVPrtdXayzLe4LSsQgpVUGa9l/VMY7VpfQ=="}} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:41:28.002302 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-3bab40d9-5727-4f06-ba78-5e222d59f618 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Getting quotas for project b094fe65c1d94c368068f0ebd9eee85a. Resources: {'key_pairs'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:41:28.006911 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.quota [None req-3bab40d9-5727-4f06-ba78-5e222d59f618 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Getting quotas for user e8cf9f6b209240339053a939bcdf1793 and project b094fe65c1d94c368068f0ebd9eee85a. Resources: {'key_pairs'} {{(pid=120508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:41:28.033219 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3bab40d9-5727-4f06-ba78-5e222d59f618 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.249121 Oct 06 12:41:28.033833 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 640/1276] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 12:41:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:41:50.509217 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1959890128", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1256939671", "security_groups": [{"name": "tempest-secgroup-smoke-1382183042"}], "networks": [{"uuid": "f1197517-971a-4a5f-a49f-a10709be2a76"}], "block_device_mapping_v2": [{"uuid": "35cf73ca-a357-439a-8976-2ad78c2f2d29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:41:50.519369 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=22 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:41:50.520164 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=46 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:41:50.622892 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.network.neutron [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] validate_networks() for [('f1197517-971a-4a5f-a49f-a10709be2a76', None, None, None, None, None)] {{(pid=120509) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:41:51.071716 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Flavor limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:41:51.072136 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Image limits 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:41:51.072732 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Flavor pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:41:51.073138 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Image pref 0:0:0 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:41:51.073576 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.virt.hardware [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:41:51.082957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:51.083444 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:51.084227 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:51.084700 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:51.085156 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:51.085581 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:51.102735 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Getting quotas for project b094fe65c1d94c368068f0ebd9eee85a. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:41:51.106727 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.quota [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Getting quotas for user e8cf9f6b209240339053a939bcdf1793 and project b094fe65c1d94c368068f0ebd9eee85a. Resources: {'cores', 'instances', 'ram'} {{(pid=120509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:41:51.162910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Going to run 1 instances... {{(pid=120509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:41:51.165137 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35cf73ca-a357-439a-8976-2ad78c2f2d29',volume_size=None,volume_type=None)] {{(pid=120509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:41:51.295150 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5ec9da06-179d-42fd-8156-080ab2a87174 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.789967 Oct 06 12:41:51.296184 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 637/1277] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 12:41:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:41:51.307031 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9b73d116-4e16-455e-8638-4cd4ae5c3014 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:51.307683 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9b73d116-4e16-455e-8638-4cd4ae5c3014 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:51.309830 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=4 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:41:51.310600 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:41:51.370115 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9b73d116-4e16-455e-8638-4cd4ae5c3014 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:51.378268 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9b73d116-4e16-455e-8638-4cd4ae5c3014 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1089 microversion: 2.1 time: 0.075091 Oct 06 12:41:51.378830 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 641/1278] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:51 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:52.401518 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-6c5e813e-e730-40f1-a165-d1a6d50cd6cc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:52.402145 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-6c5e813e-e730-40f1-a165-d1a6d50cd6cc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:52.410267 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c5e813e-e730-40f1-a165-d1a6d50cd6cc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:52.411960 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c5e813e-e730-40f1-a165-d1a6d50cd6cc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:52.412408 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c5e813e-e730-40f1-a165-d1a6d50cd6cc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:52.413284 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c5e813e-e730-40f1-a165-d1a6d50cd6cc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:52.413905 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c5e813e-e730-40f1-a165-d1a6d50cd6cc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:52.414320 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-6c5e813e-e730-40f1-a165-d1a6d50cd6cc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:52.646246 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-6c5e813e-e730-40f1-a165-d1a6d50cd6cc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:52.653890 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-6c5e813e-e730-40f1-a165-d1a6d50cd6cc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1205 microversion: 2.1 time: 0.256433 Oct 06 12:41:52.654554 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 638/1279] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:52 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1205 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:53.678258 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-14d583b1-0c6c-4dba-9985-c4498e3efc34 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:53.678879 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-14d583b1-0c6c-4dba-9985-c4498e3efc34 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:53.685237 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-14d583b1-0c6c-4dba-9985-c4498e3efc34 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:53.685726 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-14d583b1-0c6c-4dba-9985-c4498e3efc34 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:53.686164 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-14d583b1-0c6c-4dba-9985-c4498e3efc34 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:53.686942 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-14d583b1-0c6c-4dba-9985-c4498e3efc34 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:53.687405 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-14d583b1-0c6c-4dba-9985-c4498e3efc34 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:53.688172 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-14d583b1-0c6c-4dba-9985-c4498e3efc34 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:53.926924 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-14d583b1-0c6c-4dba-9985-c4498e3efc34 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:53.934753 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-14d583b1-0c6c-4dba-9985-c4498e3efc34 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1261 microversion: 2.1 time: 0.260492 Oct 06 12:41:53.935329 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 642/1280] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:53 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1261 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:54.109589 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-e8a8bbc9-197d-4898-b5af-8e796084c75c req-3aa5ece1-8d7a-46fa-a33c-7ea0cb6b519d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ba6131-e3ae-4a48-bc05-0f9e2f144cd1", "tag": "41749e41-d1ee-434e-9155-2c18daa44737"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:41:54.127394 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-e8a8bbc9-197d-4898-b5af-8e796084c75c req-3aa5ece1-8d7a-46fa-a33c-7ea0cb6b519d service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:54.128029 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-e8a8bbc9-197d-4898-b5af-8e796084c75c req-3aa5ece1-8d7a-46fa-a33c-7ea0cb6b519d service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:54.128537 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-e8a8bbc9-197d-4898-b5af-8e796084c75c req-3aa5ece1-8d7a-46fa-a33c-7ea0cb6b519d service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:54.143538 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-e8a8bbc9-197d-4898-b5af-8e796084c75c req-3aa5ece1-8d7a-46fa-a33c-7ea0cb6b519d service nova] Creating event network-changed:41749e41-d1ee-434e-9155-2c18daa44737 for instance 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 on hv-cinder-85604 Oct 06 12:41:54.149639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-e8a8bbc9-197d-4898-b5af-8e796084c75c req-3aa5ece1-8d7a-46fa-a33c-7ea0cb6b519d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044414 Oct 06 12:41:54.150039 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 639/1281] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:41:54.959024 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c8b91106-0d78-44d2-bb06-0f548ab819d5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:54.959684 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c8b91106-0d78-44d2-bb06-0f548ab819d5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:54.966011 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c8b91106-0d78-44d2-bb06-0f548ab819d5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:54.966497 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c8b91106-0d78-44d2-bb06-0f548ab819d5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:54.966936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c8b91106-0d78-44d2-bb06-0f548ab819d5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:54.968268 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c8b91106-0d78-44d2-bb06-0f548ab819d5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:54.968724 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c8b91106-0d78-44d2-bb06-0f548ab819d5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:54.969154 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c8b91106-0d78-44d2-bb06-0f548ab819d5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:55.098001 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c8b91106-0d78-44d2-bb06-0f548ab819d5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:55.105664 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c8b91106-0d78-44d2-bb06-0f548ab819d5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1261 microversion: 2.1 time: 0.150460 Oct 06 12:41:55.106233 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 643/1282] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:54 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:56.129194 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-229ab30a-ee95-452b-8227-fe00b8d4cffb tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:56.129901 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-229ab30a-ee95-452b-8227-fe00b8d4cffb tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:56.137778 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-229ab30a-ee95-452b-8227-fe00b8d4cffb tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:56.138497 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-229ab30a-ee95-452b-8227-fe00b8d4cffb tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:56.138995 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-229ab30a-ee95-452b-8227-fe00b8d4cffb tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:56.139838 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-229ab30a-ee95-452b-8227-fe00b8d4cffb tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:56.140293 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-229ab30a-ee95-452b-8227-fe00b8d4cffb tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:56.140731 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-229ab30a-ee95-452b-8227-fe00b8d4cffb tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:56.273906 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-229ab30a-ee95-452b-8227-fe00b8d4cffb tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:56.282119 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-229ab30a-ee95-452b-8227-fe00b8d4cffb tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1261 microversion: 2.1 time: 0.157271 Oct 06 12:41:56.282680 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 640/1283] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:56 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:57.305080 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-d0ed88dc-3cc6-42fc-8da5-2991bc5c7cda tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:57.305694 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-d0ed88dc-3cc6-42fc-8da5-2991bc5c7cda tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:57.312605 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d0ed88dc-3cc6-42fc-8da5-2991bc5c7cda tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:57.313089 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d0ed88dc-3cc6-42fc-8da5-2991bc5c7cda tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:57.313520 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d0ed88dc-3cc6-42fc-8da5-2991bc5c7cda tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:57.314208 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d0ed88dc-3cc6-42fc-8da5-2991bc5c7cda tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:57.314663 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d0ed88dc-3cc6-42fc-8da5-2991bc5c7cda tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:57.315089 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-d0ed88dc-3cc6-42fc-8da5-2991bc5c7cda tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:57.442157 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-d0ed88dc-3cc6-42fc-8da5-2991bc5c7cda tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:57.449711 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-d0ed88dc-3cc6-42fc-8da5-2991bc5c7cda tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1261 microversion: 2.1 time: 0.148537 Oct 06 12:41:57.450267 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 644/1284] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:57 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:58.472170 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5123e3c8-ed0a-4ec3-b1eb-5fe6d4cfbd25 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:58.472760 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5123e3c8-ed0a-4ec3-b1eb-5fe6d4cfbd25 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:58.479395 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5123e3c8-ed0a-4ec3-b1eb-5fe6d4cfbd25 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:58.479897 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5123e3c8-ed0a-4ec3-b1eb-5fe6d4cfbd25 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:58.480347 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5123e3c8-ed0a-4ec3-b1eb-5fe6d4cfbd25 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:58.481022 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5123e3c8-ed0a-4ec3-b1eb-5fe6d4cfbd25 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:58.481468 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5123e3c8-ed0a-4ec3-b1eb-5fe6d4cfbd25 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:58.481884 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5123e3c8-ed0a-4ec3-b1eb-5fe6d4cfbd25 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:58.611285 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5123e3c8-ed0a-4ec3-b1eb-5fe6d4cfbd25 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:58.618852 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5123e3c8-ed0a-4ec3-b1eb-5fe6d4cfbd25 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1261 microversion: 2.1 time: 0.150512 Oct 06 12:41:58.619407 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 641/1285] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:58 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:59.641972 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-358571c9-a255-477a-9e03-0b9ec193e3a2 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:59.642615 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-358571c9-a255-477a-9e03-0b9ec193e3a2 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:41:59.648908 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-358571c9-a255-477a-9e03-0b9ec193e3a2 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:59.649391 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-358571c9-a255-477a-9e03-0b9ec193e3a2 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:59.649827 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-358571c9-a255-477a-9e03-0b9ec193e3a2 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:59.650508 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-358571c9-a255-477a-9e03-0b9ec193e3a2 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:41:59.650967 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-358571c9-a255-477a-9e03-0b9ec193e3a2 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:41:59.651390 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-358571c9-a255-477a-9e03-0b9ec193e3a2 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:41:59.776358 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-358571c9-a255-477a-9e03-0b9ec193e3a2 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:41:59.784418 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-358571c9-a255-477a-9e03-0b9ec193e3a2 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1261 microversion: 2.1 time: 0.146979 Oct 06 12:41:59.784987 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 645/1286] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:41:59 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:42:00.808231 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-ab5f3b69-2e02-4d29-801f-59f55cece7b8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:42:00.808852 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-ab5f3b69-2e02-4d29-801f-59f55cece7b8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:42:00.815914 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab5f3b69-2e02-4d29-801f-59f55cece7b8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:00.816385 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab5f3b69-2e02-4d29-801f-59f55cece7b8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:00.816810 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab5f3b69-2e02-4d29-801f-59f55cece7b8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:00.817488 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab5f3b69-2e02-4d29-801f-59f55cece7b8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:00.817932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab5f3b69-2e02-4d29-801f-59f55cece7b8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:00.818351 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-ab5f3b69-2e02-4d29-801f-59f55cece7b8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:00.947931 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-ab5f3b69-2e02-4d29-801f-59f55cece7b8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:42:00.955396 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-ab5f3b69-2e02-4d29-801f-59f55cece7b8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1261 microversion: 2.1 time: 0.151143 Oct 06 12:42:00.955989 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 642/1287] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:42:00 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:42:01.978911 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-c12ae6de-9603-4f96-87b4-1222bb208f7e tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:42:01.979547 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-c12ae6de-9603-4f96-87b4-1222bb208f7e tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:42:01.981871 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell0:SELECT=2 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:42:01.987008 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c12ae6de-9603-4f96-87b4-1222bb208f7e tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:01.987488 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c12ae6de-9603-4f96-87b4-1222bb208f7e tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:01.987945 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c12ae6de-9603-4f96-87b4-1222bb208f7e tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:01.988628 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c12ae6de-9603-4f96-87b4-1222bb208f7e tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:01.989085 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c12ae6de-9603-4f96-87b4-1222bb208f7e tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:01.989720 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-c12ae6de-9603-4f96-87b4-1222bb208f7e tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:02.115399 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-c12ae6de-9603-4f96-87b4-1222bb208f7e tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:42:02.122946 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-c12ae6de-9603-4f96-87b4-1222bb208f7e tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1261 microversion: 2.1 time: 0.147973 Oct 06 12:42:02.123521 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 646/1288] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:42:01 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:42:03.146812 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-8c87ff6e-77f2-4b6c-bd39-5960214613cf tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:42:03.147448 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-8c87ff6e-77f2-4b6c-bd39-5960214613cf tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:42:03.149389 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=2 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:42:03.150042 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell0:SELECT=6 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:42:03.157331 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c87ff6e-77f2-4b6c-bd39-5960214613cf tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:03.158023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c87ff6e-77f2-4b6c-bd39-5960214613cf tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:03.158676 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c87ff6e-77f2-4b6c-bd39-5960214613cf tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:03.159650 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c87ff6e-77f2-4b6c-bd39-5960214613cf tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:03.160110 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c87ff6e-77f2-4b6c-bd39-5960214613cf tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:03.160536 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-8c87ff6e-77f2-4b6c-bd39-5960214613cf tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:03.291622 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-8c87ff6e-77f2-4b6c-bd39-5960214613cf tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:42:03.299339 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-8c87ff6e-77f2-4b6c-bd39-5960214613cf tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1261 microversion: 2.1 time: 0.156394 Oct 06 12:42:03.299957 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 643/1289] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:42:03 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:42:04.321090 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-cb53a62b-f7ae-46ea-aaae-97e6d4766743 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:42:04.321707 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-cb53a62b-f7ae-46ea-aaae-97e6d4766743 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:42:04.328270 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cb53a62b-f7ae-46ea-aaae-97e6d4766743 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:04.328757 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cb53a62b-f7ae-46ea-aaae-97e6d4766743 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:04.329196 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cb53a62b-f7ae-46ea-aaae-97e6d4766743 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:04.329883 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cb53a62b-f7ae-46ea-aaae-97e6d4766743 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:04.330342 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cb53a62b-f7ae-46ea-aaae-97e6d4766743 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:04.330770 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-cb53a62b-f7ae-46ea-aaae-97e6d4766743 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:04.468378 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-cb53a62b-f7ae-46ea-aaae-97e6d4766743 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:42:04.476503 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-cb53a62b-f7ae-46ea-aaae-97e6d4766743 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1261 microversion: 2.1 time: 0.159282 Oct 06 12:42:04.477065 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 647/1290] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:42:04 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:42:05.384494 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-4f57c9f3-8d61-459d-a1f0-9e4dc148a427 req-3fc6a35e-bc99-4195-a380-26f66c3a0739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ba6131-e3ae-4a48-bc05-0f9e2f144cd1", "name": "network-vif-plugged", "status": "completed", "tag": "41749e41-d1ee-434e-9155-2c18daa44737"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:42:05.394817 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-4f57c9f3-8d61-459d-a1f0-9e4dc148a427 req-3fc6a35e-bc99-4195-a380-26f66c3a0739 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:05.395998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-4f57c9f3-8d61-459d-a1f0-9e4dc148a427 req-3fc6a35e-bc99-4195-a380-26f66c3a0739 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:05.396439 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-4f57c9f3-8d61-459d-a1f0-9e4dc148a427 req-3fc6a35e-bc99-4195-a380-26f66c3a0739 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:05.410305 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-4f57c9f3-8d61-459d-a1f0-9e4dc148a427 req-3fc6a35e-bc99-4195-a380-26f66c3a0739 service nova] Creating event network-vif-plugged:41749e41-d1ee-434e-9155-2c18daa44737 for instance 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 on hv-cinder-85604 Oct 06 12:42:05.415954 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-4f57c9f3-8d61-459d-a1f0-9e4dc148a427 req-3fc6a35e-bc99-4195-a380-26f66c3a0739 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034693 Oct 06 12:42:05.416335 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 644/1291] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:42:05.499449 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2d0493ef-6258-45d9-8d26-71f54ca5df67 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:42:05.500731 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2d0493ef-6258-45d9-8d26-71f54ca5df67 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:42:05.507201 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d0493ef-6258-45d9-8d26-71f54ca5df67 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:05.507719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d0493ef-6258-45d9-8d26-71f54ca5df67 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:05.508153 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d0493ef-6258-45d9-8d26-71f54ca5df67 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:05.508838 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d0493ef-6258-45d9-8d26-71f54ca5df67 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:05.509316 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d0493ef-6258-45d9-8d26-71f54ca5df67 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:05.509736 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2d0493ef-6258-45d9-8d26-71f54ca5df67 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:05.666118 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2d0493ef-6258-45d9-8d26-71f54ca5df67 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:42:05.674945 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2d0493ef-6258-45d9-8d26-71f54ca5df67 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1261 microversion: 2.1 time: 0.179386 Oct 06 12:42:05.675581 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 648/1292] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:42:05 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:42:06.698956 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d0684aea-5b2a-4e5e-80dc-34ef464e3d01 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:42:06.699691 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d0684aea-5b2a-4e5e-80dc-34ef464e3d01 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:42:06.706507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d0684aea-5b2a-4e5e-80dc-34ef464e3d01 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:06.706991 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d0684aea-5b2a-4e5e-80dc-34ef464e3d01 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:06.707429 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d0684aea-5b2a-4e5e-80dc-34ef464e3d01 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:06.708147 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d0684aea-5b2a-4e5e-80dc-34ef464e3d01 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:06.708603 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d0684aea-5b2a-4e5e-80dc-34ef464e3d01 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:06.709031 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d0684aea-5b2a-4e5e-80dc-34ef464e3d01 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:06.837507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d0684aea-5b2a-4e5e-80dc-34ef464e3d01 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:42:06.845167 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d0684aea-5b2a-4e5e-80dc-34ef464e3d01 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1261 microversion: 2.1 time: 0.150965 Oct 06 12:42:06.845736 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 645/1293] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:42:06 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:42:07.869948 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8f037800-82f8-4bc7-8aef-27e0b42d09ae tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:42:07.870563 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8f037800-82f8-4bc7-8aef-27e0b42d09ae tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:42:07.877024 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8f037800-82f8-4bc7-8aef-27e0b42d09ae tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:07.877499 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8f037800-82f8-4bc7-8aef-27e0b42d09ae tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:07.877929 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8f037800-82f8-4bc7-8aef-27e0b42d09ae tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:07.878606 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8f037800-82f8-4bc7-8aef-27e0b42d09ae tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:07.879084 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8f037800-82f8-4bc7-8aef-27e0b42d09ae tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:07.879526 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8f037800-82f8-4bc7-8aef-27e0b42d09ae tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:08.007576 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8f037800-82f8-4bc7-8aef-27e0b42d09ae tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:42:08.016059 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8f037800-82f8-4bc7-8aef-27e0b42d09ae tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1445 microversion: 2.1 time: 0.149363 Oct 06 12:42:08.016629 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 649/1294] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:42:07 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1445 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:42:08.038247 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7adddea8-369b-4c61-8d31-c8cf623aa76f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:42:08.038850 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7adddea8-369b-4c61-8d31-c8cf623aa76f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:42:08.045095 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7adddea8-369b-4c61-8d31-c8cf623aa76f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:08.045573 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7adddea8-369b-4c61-8d31-c8cf623aa76f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:08.046003 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7adddea8-369b-4c61-8d31-c8cf623aa76f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:08.046727 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7adddea8-369b-4c61-8d31-c8cf623aa76f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:08.047171 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7adddea8-369b-4c61-8d31-c8cf623aa76f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:08.047618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7adddea8-369b-4c61-8d31-c8cf623aa76f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:08.176507 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7adddea8-369b-4c61-8d31-c8cf623aa76f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:42:08.184159 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7adddea8-369b-4c61-8d31-c8cf623aa76f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1445 microversion: 2.1 time: 0.149953 Oct 06 12:42:08.184832 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 646/1295] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:42:08 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1445 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:42:10.009741 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-decc7398-ce7c-457d-a5ad-d51a1b3b3e88 req-51cab151-5ccf-4b7e-9ba7-89098fb2356b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ba6131-e3ae-4a48-bc05-0f9e2f144cd1", "tag": "41749e41-d1ee-434e-9155-2c18daa44737"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:42:10.019429 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-decc7398-ce7c-457d-a5ad-d51a1b3b3e88 req-51cab151-5ccf-4b7e-9ba7-89098fb2356b service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:42:10.019944 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-decc7398-ce7c-457d-a5ad-d51a1b3b3e88 req-51cab151-5ccf-4b7e-9ba7-89098fb2356b service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:42:10.020414 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-decc7398-ce7c-457d-a5ad-d51a1b3b3e88 req-51cab151-5ccf-4b7e-9ba7-89098fb2356b service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:42:10.031538 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-decc7398-ce7c-457d-a5ad-d51a1b3b3e88 req-51cab151-5ccf-4b7e-9ba7-89098fb2356b service nova] Creating event network-changed:41749e41-d1ee-434e-9155-2c18daa44737 for instance 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 on hv-cinder-85604 Oct 06 12:42:10.036983 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-decc7398-ce7c-457d-a5ad-d51a1b3b3e88 req-51cab151-5ccf-4b7e-9ba7-89098fb2356b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030976 Oct 06 12:42:10.037583 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 650/1296] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:44:25.231322 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:44:25.232026 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=48 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:44:25.233468 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 12:44:25.233622 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Thu Oct 6 12:44:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1/action (ip 10.222.0.33) !!! Oct 06 12:44:25.236044 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 12:44:25.236245 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: Thu Oct 6 12:44:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1/action (ip 10.222.0.33) !!! Oct 06 12:44:25.241372 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-484e7fce-1aed-405b-82a6-c919abcc909a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:44:25.241902 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-484e7fce-1aed-405b-82a6-c919abcc909a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:25.254398 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-484e7fce-1aed-405b-82a6-c919abcc909a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:25.255525 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-484e7fce-1aed-405b-82a6-c919abcc909a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:25.255966 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-484e7fce-1aed-405b-82a6-c919abcc909a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:25.256652 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-484e7fce-1aed-405b-82a6-c919abcc909a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:25.257102 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-484e7fce-1aed-405b-82a6-c919abcc909a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:25.257523 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-484e7fce-1aed-405b-82a6-c919abcc909a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:25.282114 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.objects.instance [None req-484e7fce-1aed-405b-82a6-c919abcc909a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lazy-loading 'flavor' on Instance uuid 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 {{(pid=120509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 12:44:25.350891 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-484e7fce-1aed-405b-82a6-c919abcc909a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "POST /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1/action" status: 202 len: 0 microversion: 2.1 time: 0.121333 Oct 06 12:44:25.351553 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 647/1297] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 12:44:25 2022] POST /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:44:25.357931 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0317d93d-d293-4fb0-9e9d-9c35e292c886] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 06 12:44:25.358532 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=22 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:44:25.359450 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=50 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:44:25.360904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 12:44:25.360904 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Thu Oct 6 12:44:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 (ip 10.222.0.33) !!! Oct 06 12:44:25.362055 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 12:44:25.362189 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Thu Oct 6 12:44:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 (ip 10.222.0.33) !!! Oct 06 12:44:25.369582 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-866cdd64-509b-4657-b1e2-ad718686a6d8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:25.370296 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-866cdd64-509b-4657-b1e2-ad718686a6d8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:25.378800 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-866cdd64-509b-4657-b1e2-ad718686a6d8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:25.379291 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-866cdd64-509b-4657-b1e2-ad718686a6d8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:25.379765 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-866cdd64-509b-4657-b1e2-ad718686a6d8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:25.381131 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-866cdd64-509b-4657-b1e2-ad718686a6d8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:25.381592 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-866cdd64-509b-4657-b1e2-ad718686a6d8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:25.382021 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-866cdd64-509b-4657-b1e2-ad718686a6d8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:25.559812 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-866cdd64-509b-4657-b1e2-ad718686a6d8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:25.568157 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-866cdd64-509b-4657-b1e2-ad718686a6d8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1569 microversion: 2.1 time: 0.211458 Oct 06 12:44:25.568735 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 651/1298] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:25 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:26.592172 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-e2d83a08-60e4-438b-9885-ceb5eb63d106 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:26.592863 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-e2d83a08-60e4-438b-9885-ceb5eb63d106 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:26.600100 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2d83a08-60e4-438b-9885-ceb5eb63d106 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:26.600572 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2d83a08-60e4-438b-9885-ceb5eb63d106 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:26.600998 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2d83a08-60e4-438b-9885-ceb5eb63d106 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:26.601670 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2d83a08-60e4-438b-9885-ceb5eb63d106 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:26.602116 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2d83a08-60e4-438b-9885-ceb5eb63d106 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:26.602532 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-e2d83a08-60e4-438b-9885-ceb5eb63d106 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:26.776880 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-e2d83a08-60e4-438b-9885-ceb5eb63d106 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:26.784514 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-e2d83a08-60e4-438b-9885-ceb5eb63d106 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1569 microversion: 2.1 time: 0.196707 Oct 06 12:44:26.785082 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 648/1299] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:26 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:27.807875 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9b1ce6a6-5cf3-4a82-a5b1-ee2db3bbe669 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:27.808483 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9b1ce6a6-5cf3-4a82-a5b1-ee2db3bbe669 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:27.821450 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO oslo.messaging._drivers.impl_rabbit [-] [0317d93d-d293-4fb0-9e9d-9c35e292c886] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 46626. Oct 06 12:44:27.823851 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b1ce6a6-5cf3-4a82-a5b1-ee2db3bbe669 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:27.824334 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b1ce6a6-5cf3-4a82-a5b1-ee2db3bbe669 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:27.824769 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b1ce6a6-5cf3-4a82-a5b1-ee2db3bbe669 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:27.825464 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b1ce6a6-5cf3-4a82-a5b1-ee2db3bbe669 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:27.825914 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b1ce6a6-5cf3-4a82-a5b1-ee2db3bbe669 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:27.826337 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9b1ce6a6-5cf3-4a82-a5b1-ee2db3bbe669 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:27.955870 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-9b1ce6a6-5cf3-4a82-a5b1-ee2db3bbe669 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:27.963443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9b1ce6a6-5cf3-4a82-a5b1-ee2db3bbe669 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1569 microversion: 2.1 time: 0.159383 Oct 06 12:44:27.964035 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 652/1300] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:27 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:28.986639 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-bba0e499-c95b-4c1d-8ea7-9eb58031afb8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:28.987296 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-bba0e499-c95b-4c1d-8ea7-9eb58031afb8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:28.994226 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bba0e499-c95b-4c1d-8ea7-9eb58031afb8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:28.994707 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bba0e499-c95b-4c1d-8ea7-9eb58031afb8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:28.995146 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bba0e499-c95b-4c1d-8ea7-9eb58031afb8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:28.995855 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bba0e499-c95b-4c1d-8ea7-9eb58031afb8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:28.996306 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bba0e499-c95b-4c1d-8ea7-9eb58031afb8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:28.996728 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bba0e499-c95b-4c1d-8ea7-9eb58031afb8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:29.124023 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-bba0e499-c95b-4c1d-8ea7-9eb58031afb8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:29.132251 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-bba0e499-c95b-4c1d-8ea7-9eb58031afb8 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1569 microversion: 2.1 time: 0.149554 Oct 06 12:44:29.132826 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 649/1301] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:28 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:30.155719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-7a651cc8-6814-4605-9a3a-b611818c8ea6 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:30.156312 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-7a651cc8-6814-4605-9a3a-b611818c8ea6 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:30.163201 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7a651cc8-6814-4605-9a3a-b611818c8ea6 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:30.163724 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7a651cc8-6814-4605-9a3a-b611818c8ea6 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:30.164157 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7a651cc8-6814-4605-9a3a-b611818c8ea6 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:30.164839 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7a651cc8-6814-4605-9a3a-b611818c8ea6 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:30.165292 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7a651cc8-6814-4605-9a3a-b611818c8ea6 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:30.165719 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-7a651cc8-6814-4605-9a3a-b611818c8ea6 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:30.297092 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-7a651cc8-6814-4605-9a3a-b611818c8ea6 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:30.304728 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-7a651cc8-6814-4605-9a3a-b611818c8ea6 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1569 microversion: 2.1 time: 0.153419 Oct 06 12:44:30.305297 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 653/1302] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:30 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:31.328462 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-74c24269-04c1-449c-bdb4-454eb9d9dc5f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:31.329070 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-74c24269-04c1-449c-bdb4-454eb9d9dc5f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:31.336062 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-74c24269-04c1-449c-bdb4-454eb9d9dc5f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:31.336543 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-74c24269-04c1-449c-bdb4-454eb9d9dc5f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:31.336980 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-74c24269-04c1-449c-bdb4-454eb9d9dc5f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:31.337665 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-74c24269-04c1-449c-bdb4-454eb9d9dc5f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:31.338113 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-74c24269-04c1-449c-bdb4-454eb9d9dc5f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:31.338537 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-74c24269-04c1-449c-bdb4-454eb9d9dc5f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:31.468005 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-74c24269-04c1-449c-bdb4-454eb9d9dc5f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:31.476338 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-74c24269-04c1-449c-bdb4-454eb9d9dc5f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1569 microversion: 2.1 time: 0.151761 Oct 06 12:44:31.476908 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 650/1303] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:31 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:44:32.499440 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-8a40c25e-9ae2-4965-932d-bcec5eeaf991 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:32.500012 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-8a40c25e-9ae2-4965-932d-bcec5eeaf991 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:32.506311 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a40c25e-9ae2-4965-932d-bcec5eeaf991 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:32.506793 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a40c25e-9ae2-4965-932d-bcec5eeaf991 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:32.507229 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a40c25e-9ae2-4965-932d-bcec5eeaf991 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:32.507949 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a40c25e-9ae2-4965-932d-bcec5eeaf991 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:32.508414 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a40c25e-9ae2-4965-932d-bcec5eeaf991 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:32.508841 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-8a40c25e-9ae2-4965-932d-bcec5eeaf991 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:32.634803 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-8a40c25e-9ae2-4965-932d-bcec5eeaf991 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:32.642490 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-8a40c25e-9ae2-4965-932d-bcec5eeaf991 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1569 microversion: 2.1 time: 0.146991 Oct 06 12:44:32.643061 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 654/1304] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:32 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:44:33.666188 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f20961be-9a4f-487f-8455-855b165d5907 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:33.666792 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f20961be-9a4f-487f-8455-855b165d5907 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:33.673228 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f20961be-9a4f-487f-8455-855b165d5907 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:33.673707 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f20961be-9a4f-487f-8455-855b165d5907 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:33.674131 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f20961be-9a4f-487f-8455-855b165d5907 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:33.674805 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f20961be-9a4f-487f-8455-855b165d5907 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:33.675249 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f20961be-9a4f-487f-8455-855b165d5907 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:33.675706 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f20961be-9a4f-487f-8455-855b165d5907 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:33.812351 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f20961be-9a4f-487f-8455-855b165d5907 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:33.820744 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f20961be-9a4f-487f-8455-855b165d5907 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1569 microversion: 2.1 time: 0.158448 Oct 06 12:44:33.822787 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 651/1305] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:33 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:34.844830 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-2183e54e-26ca-4e40-9027-9434de1cfabc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:34.845407 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-2183e54e-26ca-4e40-9027-9434de1cfabc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:34.852237 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2183e54e-26ca-4e40-9027-9434de1cfabc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:34.852720 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2183e54e-26ca-4e40-9027-9434de1cfabc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:34.853180 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2183e54e-26ca-4e40-9027-9434de1cfabc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:34.853863 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2183e54e-26ca-4e40-9027-9434de1cfabc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:34.854311 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2183e54e-26ca-4e40-9027-9434de1cfabc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:34.854730 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-2183e54e-26ca-4e40-9027-9434de1cfabc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:34.980892 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-2183e54e-26ca-4e40-9027-9434de1cfabc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:34.988593 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-2183e54e-26ca-4e40-9027-9434de1cfabc tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1569 microversion: 2.1 time: 0.147662 Oct 06 12:44:34.989398 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 655/1306] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:34 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:36.012633 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-85db4fa1-829d-4879-9733-0bea715e9e4f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:36.013381 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-85db4fa1-829d-4879-9733-0bea715e9e4f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:36.019926 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-85db4fa1-829d-4879-9733-0bea715e9e4f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:36.020411 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-85db4fa1-829d-4879-9733-0bea715e9e4f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:36.020879 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-85db4fa1-829d-4879-9733-0bea715e9e4f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:36.021571 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-85db4fa1-829d-4879-9733-0bea715e9e4f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:36.022093 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-85db4fa1-829d-4879-9733-0bea715e9e4f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:36.022525 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-85db4fa1-829d-4879-9733-0bea715e9e4f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:36.225681 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-85db4fa1-829d-4879-9733-0bea715e9e4f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:36.233347 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-85db4fa1-829d-4879-9733-0bea715e9e4f tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1569 microversion: 2.1 time: 0.224642 Oct 06 12:44:36.233932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 652/1307] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:36 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:37.257501 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-b96891a2-4b54-4216-9890-58ce17422e02 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:37.258109 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-b96891a2-4b54-4216-9890-58ce17422e02 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:37.264679 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b96891a2-4b54-4216-9890-58ce17422e02 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:37.265158 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b96891a2-4b54-4216-9890-58ce17422e02 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:37.265591 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b96891a2-4b54-4216-9890-58ce17422e02 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:37.266275 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b96891a2-4b54-4216-9890-58ce17422e02 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:37.266726 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b96891a2-4b54-4216-9890-58ce17422e02 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:37.267143 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-b96891a2-4b54-4216-9890-58ce17422e02 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:37.397375 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-b96891a2-4b54-4216-9890-58ce17422e02 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:37.405017 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-b96891a2-4b54-4216-9890-58ce17422e02 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1569 microversion: 2.1 time: 0.151433 Oct 06 12:44:37.405588 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 656/1308] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:37 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:38.429757 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-5b3487f5-a3a3-4a5a-bf78-cc5dc30562b1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:38.430397 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-5b3487f5-a3a3-4a5a-bf78-cc5dc30562b1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:38.436791 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b3487f5-a3a3-4a5a-bf78-cc5dc30562b1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:38.437305 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b3487f5-a3a3-4a5a-bf78-cc5dc30562b1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:38.437738 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b3487f5-a3a3-4a5a-bf78-cc5dc30562b1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:38.438429 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b3487f5-a3a3-4a5a-bf78-cc5dc30562b1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:38.438885 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b3487f5-a3a3-4a5a-bf78-cc5dc30562b1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:38.439306 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-5b3487f5-a3a3-4a5a-bf78-cc5dc30562b1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:38.576495 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-5b3487f5-a3a3-4a5a-bf78-cc5dc30562b1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:38.584348 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-5b3487f5-a3a3-4a5a-bf78-cc5dc30562b1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1570 microversion: 2.1 time: 0.159212 Oct 06 12:44:38.584914 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 653/1309] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:38 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:38.606748 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-da94fc12-15f1-4d49-bcb8-e4a8bdb49fac tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:44:38.607367 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-da94fc12-15f1-4d49-bcb8-e4a8bdb49fac tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:38.613663 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da94fc12-15f1-4d49-bcb8-e4a8bdb49fac tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:38.614141 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da94fc12-15f1-4d49-bcb8-e4a8bdb49fac tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:38.614573 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da94fc12-15f1-4d49-bcb8-e4a8bdb49fac tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:38.615936 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da94fc12-15f1-4d49-bcb8-e4a8bdb49fac tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:38.616393 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da94fc12-15f1-4d49-bcb8-e4a8bdb49fac tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:38.616814 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-da94fc12-15f1-4d49-bcb8-e4a8bdb49fac tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:38.698650 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-da94fc12-15f1-4d49-bcb8-e4a8bdb49fac tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120508) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 12:44:38.767775 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-da94fc12-15f1-4d49-bcb8-e4a8bdb49fac tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "POST /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1/action" status: 202 len: 0 microversion: 2.1 time: 0.164711 Oct 06 12:44:38.772016 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 657/1310] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 12:44:38 2022] POST /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 12:44:38.777235 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-f9830135-20d5-411d-9bf4-d443693ccd63 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:38.778156 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-f9830135-20d5-411d-9bf4-d443693ccd63 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:38.784190 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f9830135-20d5-411d-9bf4-d443693ccd63 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:38.784709 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f9830135-20d5-411d-9bf4-d443693ccd63 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:38.785414 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f9830135-20d5-411d-9bf4-d443693ccd63 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:38.786139 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f9830135-20d5-411d-9bf4-d443693ccd63 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:38.786585 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f9830135-20d5-411d-9bf4-d443693ccd63 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:38.787060 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-f9830135-20d5-411d-9bf4-d443693ccd63 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:38.958299 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-f9830135-20d5-411d-9bf4-d443693ccd63 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:38.966520 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-f9830135-20d5-411d-9bf4-d443693ccd63 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1518 microversion: 2.1 time: 0.193441 Oct 06 12:44:38.971999 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 654/1311] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:38 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1518 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:39.991478 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-fd92a9ac-53ac-4b6a-9daf-e00e473ede15 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:39.992071 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-fd92a9ac-53ac-4b6a-9daf-e00e473ede15 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:39.997919 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fd92a9ac-53ac-4b6a-9daf-e00e473ede15 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:39.998406 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fd92a9ac-53ac-4b6a-9daf-e00e473ede15 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:39.998889 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fd92a9ac-53ac-4b6a-9daf-e00e473ede15 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:39.999558 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fd92a9ac-53ac-4b6a-9daf-e00e473ede15 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:40.000054 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fd92a9ac-53ac-4b6a-9daf-e00e473ede15 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:40.000446 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-fd92a9ac-53ac-4b6a-9daf-e00e473ede15 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:40.133604 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-fd92a9ac-53ac-4b6a-9daf-e00e473ede15 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:40.141672 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-fd92a9ac-53ac-4b6a-9daf-e00e473ede15 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1520 microversion: 2.1 time: 0.155365 Oct 06 12:44:40.142422 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 658/1312] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:39 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:41.166319 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-11de6a92-ee37-4806-b50a-de9569096918 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:41.166924 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-11de6a92-ee37-4806-b50a-de9569096918 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:41.173862 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11de6a92-ee37-4806-b50a-de9569096918 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:41.174347 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11de6a92-ee37-4806-b50a-de9569096918 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:41.174779 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11de6a92-ee37-4806-b50a-de9569096918 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:41.175563 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11de6a92-ee37-4806-b50a-de9569096918 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:41.176689 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11de6a92-ee37-4806-b50a-de9569096918 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:41.177304 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-11de6a92-ee37-4806-b50a-de9569096918 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:41.309932 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-11de6a92-ee37-4806-b50a-de9569096918 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:41.317593 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-11de6a92-ee37-4806-b50a-de9569096918 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1576 microversion: 2.1 time: 0.155128 Oct 06 12:44:41.318167 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 655/1313] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:41 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:42.048920 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-ba156c4e-0dc2-4e84-b0f1-79331f61d983 req-e37e51fd-2556-4008-8603-f0bd1a1595f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ba6131-e3ae-4a48-bc05-0f9e2f144cd1", "name": "network-vif-unplugged", "status": "completed", "tag": "41749e41-d1ee-434e-9155-2c18daa44737"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:44:42.058799 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-ba156c4e-0dc2-4e84-b0f1-79331f61d983 req-e37e51fd-2556-4008-8603-f0bd1a1595f4 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:42.059224 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-ba156c4e-0dc2-4e84-b0f1-79331f61d983 req-e37e51fd-2556-4008-8603-f0bd1a1595f4 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:42.059757 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-ba156c4e-0dc2-4e84-b0f1-79331f61d983 req-e37e51fd-2556-4008-8603-f0bd1a1595f4 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:42.070272 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-ba156c4e-0dc2-4e84-b0f1-79331f61d983 req-e37e51fd-2556-4008-8603-f0bd1a1595f4 service nova] Creating event network-vif-unplugged:41749e41-d1ee-434e-9155-2c18daa44737 for instance 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 on hv-cinder-85604 Oct 06 12:44:42.075268 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-ba156c4e-0dc2-4e84-b0f1-79331f61d983 req-e37e51fd-2556-4008-8603-f0bd1a1595f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084812 Oct 06 12:44:42.075896 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 659/1314] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:44:42.340982 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-bb9a403a-81f0-4933-9758-aed8db1fc14a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:42.341590 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-bb9a403a-81f0-4933-9758-aed8db1fc14a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:42.348040 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bb9a403a-81f0-4933-9758-aed8db1fc14a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:42.348519 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bb9a403a-81f0-4933-9758-aed8db1fc14a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:42.348946 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bb9a403a-81f0-4933-9758-aed8db1fc14a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:42.349617 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bb9a403a-81f0-4933-9758-aed8db1fc14a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:42.350065 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bb9a403a-81f0-4933-9758-aed8db1fc14a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:42.351380 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-bb9a403a-81f0-4933-9758-aed8db1fc14a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:42.478685 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-bb9a403a-81f0-4933-9758-aed8db1fc14a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:42.486280 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-bb9a403a-81f0-4933-9758-aed8db1fc14a tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1576 microversion: 2.1 time: 0.149200 Oct 06 12:44:42.486849 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 656/1315] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:42 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:43.510996 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-635342e6-061d-4b5f-becb-41f4a99cbf83 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:43.511727 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-635342e6-061d-4b5f-becb-41f4a99cbf83 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:43.517794 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-635342e6-061d-4b5f-becb-41f4a99cbf83 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:43.518283 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-635342e6-061d-4b5f-becb-41f4a99cbf83 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:43.518714 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-635342e6-061d-4b5f-becb-41f4a99cbf83 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:43.519399 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-635342e6-061d-4b5f-becb-41f4a99cbf83 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:43.519880 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-635342e6-061d-4b5f-becb-41f4a99cbf83 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:43.520308 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-635342e6-061d-4b5f-becb-41f4a99cbf83 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:43.651084 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-635342e6-061d-4b5f-becb-41f4a99cbf83 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:43.658826 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-635342e6-061d-4b5f-becb-41f4a99cbf83 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1576 microversion: 2.1 time: 0.153061 Oct 06 12:44:43.659405 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 660/1316] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:43 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:44.682975 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-13bc73ae-6c9e-45fc-9134-0a3b8738b4b5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:44.683661 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-13bc73ae-6c9e-45fc-9134-0a3b8738b4b5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:44.689991 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-13bc73ae-6c9e-45fc-9134-0a3b8738b4b5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:44.690475 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-13bc73ae-6c9e-45fc-9134-0a3b8738b4b5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:44.690910 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-13bc73ae-6c9e-45fc-9134-0a3b8738b4b5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:44.691618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-13bc73ae-6c9e-45fc-9134-0a3b8738b4b5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:44.692080 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-13bc73ae-6c9e-45fc-9134-0a3b8738b4b5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:44.692503 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-13bc73ae-6c9e-45fc-9134-0a3b8738b4b5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:44.816887 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-13bc73ae-6c9e-45fc-9134-0a3b8738b4b5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:44.825130 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-13bc73ae-6c9e-45fc-9134-0a3b8738b4b5 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1576 microversion: 2.1 time: 0.146544 Oct 06 12:44:44.825694 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 657/1317] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:44 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:45.847818 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-70be9d2e-8b7a-4dab-b794-53a5ee3bfec0 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:45.848465 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-70be9d2e-8b7a-4dab-b794-53a5ee3bfec0 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:45.854850 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70be9d2e-8b7a-4dab-b794-53a5ee3bfec0 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:45.855343 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70be9d2e-8b7a-4dab-b794-53a5ee3bfec0 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:45.855837 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70be9d2e-8b7a-4dab-b794-53a5ee3bfec0 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:45.856537 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70be9d2e-8b7a-4dab-b794-53a5ee3bfec0 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:45.856995 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70be9d2e-8b7a-4dab-b794-53a5ee3bfec0 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:45.857427 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-70be9d2e-8b7a-4dab-b794-53a5ee3bfec0 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:45.983731 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-70be9d2e-8b7a-4dab-b794-53a5ee3bfec0 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:45.991461 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-70be9d2e-8b7a-4dab-b794-53a5ee3bfec0 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1576 microversion: 2.1 time: 0.147584 Oct 06 12:44:45.992064 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 661/1318] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:45 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:47.014255 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-d8e36534-1338-4561-b753-008edc054214 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:47.014878 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-d8e36534-1338-4561-b753-008edc054214 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:47.021271 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d8e36534-1338-4561-b753-008edc054214 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:47.021749 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d8e36534-1338-4561-b753-008edc054214 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:47.022176 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d8e36534-1338-4561-b753-008edc054214 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:47.023350 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d8e36534-1338-4561-b753-008edc054214 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:47.023821 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d8e36534-1338-4561-b753-008edc054214 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:47.024234 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-d8e36534-1338-4561-b753-008edc054214 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:47.390493 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-d8e36534-1338-4561-b753-008edc054214 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:47.398654 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-d8e36534-1338-4561-b753-008edc054214 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1576 microversion: 2.1 time: 0.388362 Oct 06 12:44:47.399218 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 658/1319] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:47 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1576 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:48.421699 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-dae6dce2-f77b-432b-9a76-536c4f0303c1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:48.422305 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-dae6dce2-f77b-432b-9a76-536c4f0303c1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:48.428760 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dae6dce2-f77b-432b-9a76-536c4f0303c1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:48.429236 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dae6dce2-f77b-432b-9a76-536c4f0303c1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:48.429665 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dae6dce2-f77b-432b-9a76-536c4f0303c1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:48.430346 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dae6dce2-f77b-432b-9a76-536c4f0303c1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:48.430794 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dae6dce2-f77b-432b-9a76-536c4f0303c1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:48.431219 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-dae6dce2-f77b-432b-9a76-536c4f0303c1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:48.559169 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-dae6dce2-f77b-432b-9a76-536c4f0303c1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:48.566740 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-dae6dce2-f77b-432b-9a76-536c4f0303c1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1576 microversion: 2.1 time: 0.148904 Oct 06 12:44:48.567306 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 662/1320] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:48 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:49.590357 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-73332245-4dc2-4470-aa18-82dd218cf5a1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:49.590994 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-73332245-4dc2-4470-aa18-82dd218cf5a1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:49.597387 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-73332245-4dc2-4470-aa18-82dd218cf5a1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:49.597868 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-73332245-4dc2-4470-aa18-82dd218cf5a1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:49.598300 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-73332245-4dc2-4470-aa18-82dd218cf5a1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:49.598985 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-73332245-4dc2-4470-aa18-82dd218cf5a1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:49.599439 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-73332245-4dc2-4470-aa18-82dd218cf5a1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:49.599889 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-73332245-4dc2-4470-aa18-82dd218cf5a1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:49.728943 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-73332245-4dc2-4470-aa18-82dd218cf5a1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:49.736557 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-73332245-4dc2-4470-aa18-82dd218cf5a1 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1576 microversion: 2.1 time: 0.150182 Oct 06 12:44:49.737129 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 659/1321] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:49 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:50.760241 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-78a0fd80-29f7-4d81-82e2-25de532c2aa4 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:44:50.760841 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-78a0fd80-29f7-4d81-82e2-25de532c2aa4 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:44:50.767339 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-78a0fd80-29f7-4d81-82e2-25de532c2aa4 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:50.767869 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-78a0fd80-29f7-4d81-82e2-25de532c2aa4 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:50.768310 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-78a0fd80-29f7-4d81-82e2-25de532c2aa4 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:50.769007 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-78a0fd80-29f7-4d81-82e2-25de532c2aa4 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:50.769473 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-78a0fd80-29f7-4d81-82e2-25de532c2aa4 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:50.769901 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-78a0fd80-29f7-4d81-82e2-25de532c2aa4 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:50.902578 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-78a0fd80-29f7-4d81-82e2-25de532c2aa4 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:44:50.910540 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-78a0fd80-29f7-4d81-82e2-25de532c2aa4 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1563 microversion: 2.1 time: 0.154569 Oct 06 12:44:50.911118 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 663/1322] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:44:50 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:44:52.051926 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-f521cd0e-37a0-494b-9542-ee44674bf160 req-5c518ba3-2fea-4081-bf90-768a51267b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ba6131-e3ae-4a48-bc05-0f9e2f144cd1", "name": "network-vif-plugged", "status": "completed", "tag": "41749e41-d1ee-434e-9155-2c18daa44737"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:44:52.063075 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-f521cd0e-37a0-494b-9542-ee44674bf160 req-5c518ba3-2fea-4081-bf90-768a51267b99 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:44:52.063848 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-f521cd0e-37a0-494b-9542-ee44674bf160 req-5c518ba3-2fea-4081-bf90-768a51267b99 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:44:52.063999 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-f521cd0e-37a0-494b-9542-ee44674bf160 req-5c518ba3-2fea-4081-bf90-768a51267b99 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:44:52.075232 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-f521cd0e-37a0-494b-9542-ee44674bf160 req-5c518ba3-2fea-4081-bf90-768a51267b99 service nova] Creating event network-vif-plugged:41749e41-d1ee-434e-9155-2c18daa44737 for instance 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 on hv-cinder-85604 Oct 06 12:44:52.080273 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-f521cd0e-37a0-494b-9542-ee44674bf160 req-5c518ba3-2fea-4081-bf90-768a51267b99 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032051 Oct 06 12:44:52.080883 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 660/1323] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:46:26.582370 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:46:26.583116 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG dbcounter [-] [120508] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:46:26.584913 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_api:SELECT=28 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:46:26.585888 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG dbcounter [-] [120509] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:46:26.598559 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-3506679f-e552-4661-85bb-e5bc3f6bd13c tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:46:26.599052 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3506679f-e552-4661-85bb-e5bc3f6bd13c tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:46:26.609443 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3506679f-e552-4661-85bb-e5bc3f6bd13c tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:26.609917 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3506679f-e552-4661-85bb-e5bc3f6bd13c tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:26.610351 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3506679f-e552-4661-85bb-e5bc3f6bd13c tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:26.611377 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3506679f-e552-4661-85bb-e5bc3f6bd13c tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:26.612623 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3506679f-e552-4661-85bb-e5bc3f6bd13c tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:26.613187 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-3506679f-e552-4661-85bb-e5bc3f6bd13c tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:26.641093 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-3506679f-e552-4661-85bb-e5bc3f6bd13c tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Going to try to terminate instance {{(pid=120508) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:46:26.655385 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [req-e21b8277-02dc-4f2c-9793-11fd671a69c1 req-615c83d6-aff0-40b8-9f5e-56c6520dcd6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ba6131-e3ae-4a48-bc05-0f9e2f144cd1", "tag": "41749e41-d1ee-434e-9155-2c18daa44737"}]} {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:46:26.665289 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-e21b8277-02dc-4f2c-9793-11fd671a69c1 req-615c83d6-aff0-40b8-9f5e-56c6520dcd6f service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:26.665762 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-e21b8277-02dc-4f2c-9793-11fd671a69c1 req-615c83d6-aff0-40b8-9f5e-56c6520dcd6f service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:26.666186 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [req-e21b8277-02dc-4f2c-9793-11fd671a69c1 req-615c83d6-aff0-40b8-9f5e-56c6520dcd6f service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:26.677180 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.compute.server_external_events [req-e21b8277-02dc-4f2c-9793-11fd671a69c1 req-615c83d6-aff0-40b8-9f5e-56c6520dcd6f service nova] Creating event network-changed:41749e41-d1ee-434e-9155-2c18daa44737 for instance 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 on hv-cinder-85604 Oct 06 12:46:26.683441 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [req-e21b8277-02dc-4f2c-9793-11fd671a69c1 req-615c83d6-aff0-40b8-9f5e-56c6520dcd6f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102950 Oct 06 12:46:26.684481 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 661/1324] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:46:26.734186 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-3506679f-e552-4661-85bb-e5bc3f6bd13c tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "DELETE /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 204 len: 0 microversion: 2.1 time: 0.156464 Oct 06 12:46:26.738347 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 664/1325] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 12:46:26 2022] DELETE /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:46:26.748618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b70d3207-7a05-4a43-b3f9-e40629cc4326 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:46:26.748618 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-b70d3207-7a05-4a43-b3f9-e40629cc4326 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:46:26.752490 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b70d3207-7a05-4a43-b3f9-e40629cc4326 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:26.752972 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b70d3207-7a05-4a43-b3f9-e40629cc4326 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:26.753399 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b70d3207-7a05-4a43-b3f9-e40629cc4326 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:26.754087 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b70d3207-7a05-4a43-b3f9-e40629cc4326 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:26.754530 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b70d3207-7a05-4a43-b3f9-e40629cc4326 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:26.754941 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-b70d3207-7a05-4a43-b3f9-e40629cc4326 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:26.888437 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-b70d3207-7a05-4a43-b3f9-e40629cc4326 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:46:26.896438 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b70d3207-7a05-4a43-b3f9-e40629cc4326 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1569 microversion: 2.1 time: 0.156743 Oct 06 12:46:26.897112 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 662/1326] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:46:26 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:46:27.966788 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-feaded75-c43f-4805-95bd-892c8c845487 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:46:27.967498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-feaded75-c43f-4805-95bd-892c8c845487 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:46:27.973354 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-feaded75-c43f-4805-95bd-892c8c845487 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:27.973836 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-feaded75-c43f-4805-95bd-892c8c845487 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:27.974342 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-feaded75-c43f-4805-95bd-892c8c845487 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:27.975037 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-feaded75-c43f-4805-95bd-892c8c845487 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:27.975544 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-feaded75-c43f-4805-95bd-892c8c845487 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:27.975975 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-feaded75-c43f-4805-95bd-892c8c845487 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:28.108602 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.policy [None req-feaded75-c43f-4805-95bd-892c8c845487 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120508) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:46:28.116273 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-feaded75-c43f-4805-95bd-892c8c845487 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1569 microversion: 2.1 time: 0.199992 Oct 06 12:46:28.116846 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 665/1327] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:46:27 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:46:29.141141 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-7ae1a687-03bc-4593-aaf7-bb54baeb846d tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:46:29.142395 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.compute.api [None req-7ae1a687-03bc-4593-aaf7-bb54baeb846d tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120509) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:46:29.142644 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [req-786e9d20-2aaa-4c2f-8469-88d76292fca2 req-0310e7b5-fbba-4fb7-b4a1-ece34884c437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ba6131-e3ae-4a48-bc05-0f9e2f144cd1", "name": "network-vif-deleted", "tag": "41749e41-d1ee-434e-9155-2c18daa44737"}]} {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:46:29.148838 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7ae1a687-03bc-4593-aaf7-bb54baeb846d tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:29.149461 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7ae1a687-03bc-4593-aaf7-bb54baeb846d tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:29.150559 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7ae1a687-03bc-4593-aaf7-bb54baeb846d tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:29.151465 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7ae1a687-03bc-4593-aaf7-bb54baeb846d tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:29.151951 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7ae1a687-03bc-4593-aaf7-bb54baeb846d tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:29.152376 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG oslo_concurrency.lockutils [None req-7ae1a687-03bc-4593-aaf7-bb54baeb846d tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:29.154939 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-786e9d20-2aaa-4c2f-8469-88d76292fca2 req-0310e7b5-fbba-4fb7-b4a1-ece34884c437 service nova] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:29.155638 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-786e9d20-2aaa-4c2f-8469-88d76292fca2 req-0310e7b5-fbba-4fb7-b4a1-ece34884c437 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:29.156142 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [req-786e9d20-2aaa-4c2f-8469-88d76292fca2 req-0310e7b5-fbba-4fb7-b4a1-ece34884c437 service nova] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:29.168983 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.compute.server_external_events [req-786e9d20-2aaa-4c2f-8469-88d76292fca2 req-0310e7b5-fbba-4fb7-b4a1-ece34884c437 service nova] Creating event network-vif-deleted:41749e41-d1ee-434e-9155-2c18daa44737 for instance 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 on hv-cinder-85604 Oct 06 12:46:29.175749 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [req-786e9d20-2aaa-4c2f-8469-88d76292fca2 req-0310e7b5-fbba-4fb7-b4a1-ece34884c437 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036484 Oct 06 12:46:29.176356 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 666/1328] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 12:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:46:29.223911 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.policy [None req-7ae1a687-03bc-4593-aaf7-bb54baeb846d tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8cf9f6b209240339053a939bcdf1793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b094fe65c1d94c368068f0ebd9eee85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120509) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:46:29.231733 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-7ae1a687-03bc-4593-aaf7-bb54baeb846d tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 200 len: 1383 microversion: 2.1 time: 0.094593 Oct 06 12:46:29.232308 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 663/1329] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:46:29 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 1383 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:46:30.254901 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9ebec28d-be7b-4f74-be8f-5ea2ac721dd9 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '>' {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:46:30.255636 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.compute.api [None req-9ebec28d-be7b-4f74-be8f-5ea2ac721dd9 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] [instance: 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1] Fetching instance by UUID {{(pid=120508) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:46:30.262991 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ebec28d-be7b-4f74-be8f-5ea2ac721dd9 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:30.263471 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ebec28d-be7b-4f74-be8f-5ea2ac721dd9 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:30.263927 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ebec28d-be7b-4f74-be8f-5ea2ac721dd9 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:30.264624 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ebec28d-be7b-4f74-be8f-5ea2ac721dd9 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Acquiring lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:30.265075 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ebec28d-be7b-4f74-be8f-5ea2ac721dd9 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:30.265498 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG oslo_concurrency.lockutils [None req-9ebec28d-be7b-4f74-be8f-5ea2ac721dd9 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Lock "bb99d91a-faea-4edc-b2f3-5f1d1dc1315d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:30.279070 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.wsgi [None req-9ebec28d-be7b-4f74-be8f-5ea2ac721dd9 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] HTTP exception thrown: Instance 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 could not be found. Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9ebec28d-be7b-4f74-be8f-5ea2ac721dd9 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Request method failure captured: Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: request: GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 HTTP/1.1 Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept: application/json Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Accept-Encoding: identity Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Connection: close Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Length: 0 Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Content-Type: application/json Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Host: 10.222.0.33 Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: Openstack-System-Scope: None Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: User-Agent: python-urllib3/1.26.12 Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Auth-Token: gAAAAABjPszyCP45PelsrbJB29hHbqC79Rvljc_TddmYZNs5glObM8UqgFNgWkzVsDXGdYF_OZwarQiCV-Rqt61NBBtMrYU4LWRuEkqiNB3DrhggsSqCbyamV5-P142i27PISYPjbkpIOWgrEvyXbr13Eo_PQ9JxkL1qYx0L3m1YmbapWi10KSc Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Id: None Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Domain-Name: None Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Identity-Status: Confirmed Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Is-Admin-Project: True Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Id: default Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Domain-Name: Default Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Id: b094fe65c1d94c368068f0ebd9eee85a Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Project-Name: tempest-TestShelveInstance-380913540 Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Role: member,reader Oct 06 12:46:30.281133 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Roles: member,reader Oct 06 12:46:30.282952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b094fe65c1d94c368068f0ebd9eee85a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b094fe65c1d94c368068f0ebd9eee85a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b094fe65c1d94c368068f0ebd9eee85a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b094fe65c1d94c368068f0ebd9eee85a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 06 12:46:30.282952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant: tempest-TestShelveInstance-380913540 Oct 06 12:46:30.282952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Id: b094fe65c1d94c368068f0ebd9eee85a Oct 06 12:46:30.282952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-Tenant-Name: tempest-TestShelveInstance-380913540 Oct 06 12:46:30.282952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User: tempest-TestShelveInstance-380913540-project Oct 06 12:46:30.282952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Id: default Oct 06 12:46:30.282952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Domain-Name: Default Oct 06 12:46:30.282952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Id: e8cf9f6b209240339053a939bcdf1793 Oct 06 12:46:30.282952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: X-User-Name: tempest-TestShelveInstance-380913540-project Oct 06 12:46:30.282952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: method: > Oct 06 12:46:30.282952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: exception: Instance 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 could not be found. Oct 06 12:46:30.282952 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: action_args: {'id': '62ba6131-e3ae-4a48-bc05-0f9e2f144cd1'} Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: {{(pid=120508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 could not be found. Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:46:30.284385 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 could not be found. Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 could not be found. Oct 06 12:46:30.286175 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: ERROR nova.api.openstack.wsgi Oct 06 12:46:30.287764 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: DEBUG nova.api.openstack.wsgi [None req-9ebec28d-be7b-4f74-be8f-5ea2ac721dd9 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Returning 404 to user: Instance 62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 could not be found. {{(pid=120508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:46:30.287764 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: INFO nova.api.openstack.requestlog [None req-9ebec28d-be7b-4f74-be8f-5ea2ac721dd9 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1" status: 404 len: 111 microversion: 2.1 time: 0.032049 Oct 06 12:46:30.287764 dv-cinder-856041-2-iscsi devstack@n-api.service[120508]: [pid: 120508|app: 0|req: 667/1330] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 12:46:30 2022] GET /compute/v2.1/servers/62ba6131-e3ae-4a48-bc05-0f9e2f144cd1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:46:30.441116 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: DEBUG nova.api.openstack.wsgi [None req-b80d19eb-97a1-43a1-b891-fe2defccb5d9 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] Calling method '.version_select at 0x7f03ae20d8b0>' {{(pid=120509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:46:30.466385 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: INFO nova.api.openstack.requestlog [None req-b80d19eb-97a1-43a1-b891-fe2defccb5d9 tempest-TestShelveInstance-380913540 tempest-TestShelveInstance-380913540-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1256939671" status: 202 len: 0 microversion: 2.1 time: 0.029322 Oct 06 12:46:30.467142 dv-cinder-856041-2-iscsi devstack@n-api.service[120509]: [pid: 120509|app: 0|req: 664/1331] 10.222.0.33 () {58 vars in 1254 bytes} [Thu Oct 6 12:46:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1256939671 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)